[ 521.754545] env[65902]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.754545] env[65902]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.748548] env[65992]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.748548] env[65992]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 524.304017] env[65992]: INFO neutron.common.config [-] Logging enabled! [ 524.304017] env[65992]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev20 [ 524.304017] env[65992]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65992) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 524.304017] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 524.304017] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 524.304017] env[65992]: WARNING oslo_policy.policy [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.304017] env[65992]: WARNING oslo_policy.policy [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.304618] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] VMware NSXv3 Agent initialized successfully. [ 524.304618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] Acquiring lock "singleton_lock" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.304618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] Acquired lock "singleton_lock" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.304706] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] Releasing lock "singleton_lock" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.305095] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] Full set of CONF: {{(pid=65992) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 524.305095] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ******************************************************************************** {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 524.305196] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] Configuration options gathered from: {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 524.305524] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 524.305714] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 524.305819] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ================================================================================ {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 524.305982] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] agent_down_time = 75 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.306126] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] allow_automatic_dhcp_failover = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.306255] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] allow_bulk = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.306389] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] api_extensions_path = {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.306519] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] api_paste_config = api-paste.ini {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.306677] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] auth_strategy = keystone {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.306798] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] backdoor_port = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.306898] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] backdoor_socket = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.307040] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] backlog = 4096 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.307172] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] base_mac = fa:16:3e:00:00:00 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.307366] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] bind_host = 0.0.0.0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.307457] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] bind_port = 9696 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.307575] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] client_socket_timeout = 900 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.307702] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] config_dir = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.307802] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.307931] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] config_source = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.308070] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] control_exchange = neutron {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.308221] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] core_plugin = ml2 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.308325] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] debug = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.308450] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] default_availability_zones = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309055] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309055] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] dhcp_agent_notification = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309055] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] dhcp_agents_per_network = 1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309055] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] dhcp_lease_duration = 86400 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309313] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] dhcp_load_type = networks {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309313] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] dns_domain = openstacklocal {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309403] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309509] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] enable_default_route_bfd = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309637] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] enable_default_route_ecmp = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309758] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] enable_dvr = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.309877] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] enable_new_agents = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.310585] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.310585] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] enable_signals = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.310585] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] enable_traditional_dhcp = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.310585] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] external_dns_driver = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.310585] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] filter_validation = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.310585] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] global_physnet_mtu = 8950 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.311109] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] graceful_shutdown_timeout = 60 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.311109] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] host = cpu-1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.311109] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] host_dvr_for_dhcp = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.311243] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] http_retries = 3 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.311243] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] instance_format = [instance: %(uuid)s] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.311378] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.311538] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ipam_driver = internal {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.311683] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ipv6_pd_enabled = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.312568] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] l3_ha = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.312739] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.312888] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] l3_ha_network_physical_name = {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.313039] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] l3_ha_network_type = {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.313183] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_color = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.313317] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_config_append = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.313453] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.313583] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_dir = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.313711] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_file = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.313812] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_options = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.313941] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_rotate_interval = 1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.314087] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_rotate_interval_type = days {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.314225] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] log_rotation_type = none {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.314332] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.314433] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.314569] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.314734] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.314839] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.314974] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] max_dns_nameservers = 5 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.315150] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] max_header_line = 16384 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.315278] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] max_l3_agents_per_router = 3 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.315423] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] max_logfile_count = 30 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.315551] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] max_logfile_size_mb = 200 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.315701] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] max_subnet_host_routes = 20 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.315846] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] my_ip = 10.180.1.21 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.315980] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] my_ipv6 = ::1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.316664] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] network_auto_schedule = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.316664] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] network_link_prefix = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.316664] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.316664] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] notify_nova_on_port_data_changes = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.316664] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] notify_nova_on_port_status_changes = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.316957] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] pagination_max_limit = -1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.316957] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] publish_errors = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.317074] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] rate_limit_burst = 0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.317156] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] rate_limit_except_level = CRITICAL {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.317277] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] rate_limit_interval = 0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.317406] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] retry_until_window = 30 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.317531] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] router_distributed = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.317657] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] rpc_resources_processing_step = 20 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.317781] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] rpc_response_max_timeout = 600 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.317908] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] rpc_response_timeout = 60 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.318042] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] send_events_interval = 2 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.318187] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] service_plugins = ['router'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.318320] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] setproctitle = on {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.318437] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] shell_completion = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.318567] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] state_path = /opt/stack/data/neutron {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.318699] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] syslog_log_facility = LOG_USER {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.318827] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] tcp_keepidle = 600 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.318959] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] transport_url = **** {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.319099] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] use_journal = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.319224] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] use_json = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.319350] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] use_ssl = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.319473] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] use_stderr = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.319603] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] use_syslog = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.319723] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] vlan_qinq = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.319845] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] vlan_transparent = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.319969] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] watch_log_file = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.320126] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] wsgi_default_pool_size = 100 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.320254] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] wsgi_keep_alive = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.320386] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.320511] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] wsgi_server_debug = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.320658] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_concurrency.disable_process_locking = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.320799] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.320935] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.321075] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.321212] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.321344] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.321486] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.321637] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.connection_string = messaging:// {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.321771] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.enabled = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.321907] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.es_doc_type = notification {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.322043] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.es_scroll_size = 10000 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.322179] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.es_scroll_time = 2m {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.322308] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.filter_error_trace = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.322439] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.hmac_keys = **** {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.322569] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.sentinel_service_name = mymaster {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.322704] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.socket_timeout = 0.1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.322835] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.trace_requests = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.322961] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler.trace_sqlalchemy = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.323115] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler_jaeger.process_tags = {} {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.323242] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler_jaeger.service_name_prefix = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.323371] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] profiler_otlp.service_name_prefix = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.323541] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.enforce_new_defaults = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.323804] env[65992]: WARNING oslo_config.cfg [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 524.323949] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.enforce_scope = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.324101] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.policy_default_rule = default {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.324253] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.324419] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.324562] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.324709] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.324840] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.324967] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.325109] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.325264] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_policy.remote_timeout = 60.0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.325407] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.325549] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] agent.extensions = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.325714] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.325851] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] service_providers.service_provider = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.325990] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.default_quota = -1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.326147] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.326291] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_floatingip = 50 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.326423] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_network = 100 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.326550] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_port = 500 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.326677] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.326806] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_router = 10 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.326931] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_security_group = 10 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.327069] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.327197] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.quota_subnet = 100 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.327323] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] QUOTAS.track_quota_usage = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.327467] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.327595] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep.group = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.327722] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep.helper_command = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.327857] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep.log_daemon_traceback = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.327983] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.328122] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep.thread_pool_size = 8 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.328247] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep.user = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.328383] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.328509] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_dhcp_release.group = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.328634] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_dhcp_release.helper_command = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.328764] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.328891] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.329033] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.329152] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_dhcp_release.user = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.329287] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.329411] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_ovs_vsctl.group = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.329533] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_ovs_vsctl.helper_command = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.330651] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.330651] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.330651] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.330651] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_ovs_vsctl.user = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.330651] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_namespace.capabilities = [21] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.330651] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_namespace.group = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.330651] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_namespace.helper_command = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331166] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_namespace.log_daemon_traceback = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331166] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331166] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_namespace.thread_pool_size = 8 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331166] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_namespace.user = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331166] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_conntrack.capabilities = [12] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331166] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_conntrack.group = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331358] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_conntrack.helper_command = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331389] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331504] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331653] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331817] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_conntrack.user = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.331962] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_link.capabilities = [12, 21] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.332103] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_link.group = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.332227] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_link.helper_command = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.332355] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_link.log_daemon_traceback = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.332486] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.332614] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_link.thread_pool_size = 8 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.332737] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] privsep_link.user = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.332884] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.333032] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.333166] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.continue_on_failed_promotions = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.333293] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.dscp = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.333422] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.dscp_inherit = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.333557] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.force_mp_to_policy = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.333684] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.locking_coordinator_url = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.333812] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.log_agent_heartbeats = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.333940] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.logging_expire = 1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.334083] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.334216] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.334352] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.polling_interval = 240 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.334481] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.334616] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.334758] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.report_interval = 30.0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.334893] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.335034] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.335172] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.335304] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.sync_skew = 60 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.335431] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.synchronization_queue_size = 20 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.335571] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT.use_helper_for_ns_read = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.335767] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] SECURITYGROUP.enable_ipset = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.335921] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] SECURITYGROUP.enable_security_group = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.336071] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.336212] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.336349] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] experimental.ipv6_pd_enabled = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.336499] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.extension_drivers = ['port_security'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.336627] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.external_network_type = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.336771] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.336908] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.overlay_ip_version = 4 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.337058] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.path_mtu = 8950 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.337199] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.physical_network_mtus = {} {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.337339] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.tenant_network_types = ['vlan'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.337478] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.337620] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ml2.type_drivers = ['vlan'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.337767] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT_CLI.neutron_port_id = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.337901] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.338044] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.338190] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.338329] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.338460] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.338594] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.338784] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.338957] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.339174] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.339321] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_login_password = **** {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.339463] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_login_port = 443 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.339597] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_login_user = admin {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.339734] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.339873] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.340030] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.340150] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.340288] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.340434] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.340566] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.340701] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.340836] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.340970] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.341124] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.341258] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.341393] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.341580] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.341722] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] vsphere.vsphere_login_password = VMware1! {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.341859] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.341989] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.342139] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.auth_section = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.342279] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.auth_type = password {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.342415] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.342540] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.certfile = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.342669] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.collect_timing = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.342807] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.endpoint_type = public {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.342935] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.insecure = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.343070] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.keyfile = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.343208] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.region_name = RegionOne {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.343335] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.split_loggers = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.343459] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] nova.timeout = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.343654] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.auth_section = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.343821] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.auth_type = password {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.343961] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344103] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.certfile = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344235] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.collect_timing = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344369] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.endpoint_type = public {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344495] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.insecure = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344618] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.keyfile = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344747] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.region_name = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344883] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.split_loggers = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345016] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] placement.timeout = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345158] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.auth_section = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345285] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.auth_type = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345410] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.cafile = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345533] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.certfile = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345700] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.collect_timing = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345833] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.connect_retries = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345961] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.connect_retry_delay = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346102] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.enable_notifications = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346227] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.endpoint_override = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346359] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.insecure = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346481] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.interface = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346607] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.keyfile = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346731] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.max_version = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346854] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.min_version = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346976] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.region_name = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347110] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.retriable_status_codes = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347233] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.service_name = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347353] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.service_type = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347476] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.split_loggers = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347597] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.status_code_retries = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347728] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.status_code_retry_delay = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347850] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.timeout = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347999] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.valid_interfaces = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348144] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ironic.version = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348280] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] cli_script.dry_run = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348421] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348550] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348679] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348806] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348933] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349073] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349204] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349334] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349463] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349602] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349726] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349860] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349991] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350138] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350271] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350405] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350533] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350661] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350800] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350929] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351065] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351196] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351322] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351448] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351574] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351700] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351827] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351956] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352095] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352227] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352356] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.ssl = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352490] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352627] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352754] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352885] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353027] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.ssl_version = {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353159] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353300] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_notifications.driver = [] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353431] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_notifications.retry = -1 {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353608] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353741] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] oslo_messaging_notifications.transport_url = **** {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353848] env[65992]: DEBUG oslo_service.backend._eventlet.service [None req-d280e067-7e26-41e0-a6a9-f7be1a6687eb None None] ******************************************************************************** {{(pid=65992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 524.354987] env[65992]: DEBUG neutron.agent.securitygroups_rpc [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Init firewall settings (driver=nsxv3) {{(pid=65992) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 524.356355] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65992) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 524.356900] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] RPC agent_id: nsxm-l-01a.corp.local [ 524.359817] env[65992]: DEBUG dogpile.cache.region [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.359817] env[65992]: DEBUG dogpile.lock [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 524.359817] env[65992]: DEBUG dogpile.lock [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 524.359817] env[65992]: DEBUG dogpile.lock [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 524.359817] env[65992]: DEBUG dogpile.cache.region [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.359817] env[65992]: DEBUG dogpile.lock [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 524.359817] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 524.411204] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Session token - acquiring [ 524.413069] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.413286] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.413372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.413893] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.426543] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.697297] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 524.720327] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 524.720590] env[65992]: DEBUG dogpile.cache.region [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Cache value generated in 0.361 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 524.720590] env[65992]: DEBUG dogpile.lock [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 524.720710] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Activating Policy API Provider. [ 524.720905] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Looking for the default Infrastructure Rules. [ 524.796698] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Looking for the Default Layer3 Logged Drop Section. [ 524.814855] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 524.815355] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.815530] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.815720] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.816096] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.816648] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.332427] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.835227] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.337545] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Inventory metadata is going to be refreshed. [ 526.338038] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.099079] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.099407] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.099407] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.099688] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.111861] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.112778] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.113506] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 527.131107] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.131486] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.131633] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.131934] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.132063] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.132212] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 527.132321] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.132422] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 527.156184] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.156499] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.156499] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.156771] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.156940] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.157095] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 527.179659] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.179934] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.179994] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.180320] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.180487] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.180734] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 527.200336] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.200618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.200682] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.201030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.201178] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.201342] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 527.201466] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.201572] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 527.221978] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.222286] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.222286] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.222569] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.222690] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.222835] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 527.222933] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.223047] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 527.243530] env[65992]: DEBUG networking_nsxv3.common.locking [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.243823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.243823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.244095] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.244236] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.244416] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 527.244569] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.244569] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Inventory metadata have been refreshed. [ 527.244725] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Dryrun:True. Metadata refresh completed. [ 527.244788] env[65992]: DEBUG oslo_concurrency.lockutils [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Releasing lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.246597] env[65992]: INFO neutron.agent.agent_extensions_manager [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Loaded agent extensions: [] [ 527.247330] env[65992]: DEBUG neutron_lib.callbacks.manager [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65992) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 527.301394] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent RPC Daemon Started! [ 527.301554] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent loop - iteration:0 started [ 527.301635] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent out of sync with plugin! [ 532.248615] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 532.249113] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 537.250082] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.250468] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.237066] env[65992]: INFO networking_nsxv3.common.synchronization [None req-cf7427f7-7b46-4bcb-9178-9fae3bc1db26 demo admin] Enqueued Resource ID: 3407c459-050b-4fd0-b8d5-f79f503bcfc5 with Priority: HIGHEST for action security_group_rules [ 542.237466] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3407c459-050b-4fd0-b8d5-f79f503bcfc5 with Priority: HIGHEST for action security_group_rules [ 542.237768] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3407c459-050b-4fd0-b8d5-f79f503bcfc5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.237891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3407c459-050b-4fd0-b8d5-f79f503bcfc5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.237959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3407c459-050b-4fd0-b8d5-f79f503bcfc5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.238342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3407c459-050b-4fd0-b8d5-f79f503bcfc5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.238424] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3407c459-050b-4fd0-b8d5-f79f503bcfc5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.249861] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.249997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.250076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.250377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.250516] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.752513] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.760010] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.760197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.760242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.760415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.760499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.760595] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3407c459-050b-4fd0-b8d5-f79f503bcfc5 already deleted. [ 542.760676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3407c459-050b-4fd0-b8d5-f79f503bcfc5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.255697] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.758144] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 543.758325] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 544.481551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.482062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.482062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.482062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.493760] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 544.494664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.495298] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 544.514064] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.514319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.514319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.514473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.514558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.514661] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 544.514730] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 544.514796] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 544.533732] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.533978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.533978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.534153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.534284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.534389] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 544.555612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.555900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.555900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.556057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.556138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.556247] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 544.575014] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.575223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.575223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.575408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.575506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.575620] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 544.575691] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 544.575760] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 544.593649] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.593848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.593848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.594061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.594145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.594257] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 544.594328] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 544.594430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 544.619787] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.620069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.620069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.620280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.620399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.620523] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 544.620603] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 544.620654] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 544.620701] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 544.620779] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 544.620838] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 544.620885] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 544.621196] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 544.621287] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 544.621337] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 544.644118] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.644360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.644360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.644574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.644701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.644827] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 544.665415] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.665626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.665626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.665806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.665938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.678409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.239317] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 547.239747] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 552.240403] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.240616] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.242146] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.242519] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.243196] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.243603] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.244642] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.245041] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.620965] env[65992]: INFO networking_nsxv3.common.synchronization [None req-86b5f75a-2fff-4efa-8c54-11bfac0242de None None] Enqueued Resource ID: 94461f72-dbd8-4a7d-9f2f-aa7be39b6783 with Priority: HIGHEST for action port [ 568.624253] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94461f72-dbd8-4a7d-9f2f-aa7be39b6783 with Priority: HIGHEST for action port [ 568.624253] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-94461f72-dbd8-4a7d-9f2f-aa7be39b6783 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.624253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94461f72-dbd8-4a7d-9f2f-aa7be39b6783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.624253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94461f72-dbd8-4a7d-9f2f-aa7be39b6783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.624253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94461f72-dbd8-4a7d-9f2f-aa7be39b6783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.624253] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94461f72-dbd8-4a7d-9f2f-aa7be39b6783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.126719] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94461f72-dbd8-4a7d-9f2f-aa7be39b6783 [ 569.126942] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.127245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.127245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.127708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.127708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.127708] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94461f72-dbd8-4a7d-9f2f-aa7be39b6783 already deleted. [ 569.128035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94461f72-dbd8-4a7d-9f2f-aa7be39b6783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.447807] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d344ec95-929d-49f0-a9df-549ad89ffab9 None None] Enqueued Resource ID: 9ee90000-9862-47ca-a5f3-095bd9781472 with Priority: HIGHEST for action port [ 570.448388] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee90000-9862-47ca-a5f3-095bd9781472 with Priority: HIGHEST for action port [ 570.448656] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ee90000-9862-47ca-a5f3-095bd9781472 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.448917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ee90000-9862-47ca-a5f3-095bd9781472" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.448917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ee90000-9862-47ca-a5f3-095bd9781472" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.449125] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ee90000-9862-47ca-a5f3-095bd9781472" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.449201] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ee90000-9862-47ca-a5f3-095bd9781472',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.951538] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ee90000-9862-47ca-a5f3-095bd9781472 [ 570.951814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.951953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.952048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.952251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.952382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.952445] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ee90000-9862-47ca-a5f3-095bd9781472 already deleted. [ 570.952492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ee90000-9862-47ca-a5f3-095bd9781472" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.589702] env[65992]: INFO networking_nsxv3.common.synchronization [None req-24574aad-ce2e-481a-8fed-eabbc0914d48 None None] Enqueued Resource ID: 56cbc236-03af-4740-b88f-f6d51019e9d2 with Priority: HIGHEST for action port [ 573.589957] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56cbc236-03af-4740-b88f-f6d51019e9d2 with Priority: HIGHEST for action port [ 573.590808] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-56cbc236-03af-4740-b88f-f6d51019e9d2 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.590926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56cbc236-03af-4740-b88f-f6d51019e9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.590987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56cbc236-03af-4740-b88f-f6d51019e9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.591382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56cbc236-03af-4740-b88f-f6d51019e9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.591461] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56cbc236-03af-4740-b88f-f6d51019e9d2',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.640022] env[65992]: INFO networking_nsxv3.common.synchronization [None req-4dbb3a88-4e23-4af0-99b4-1f1ddaa33442 None None] Enqueued Resource ID: e4929ed9-ff3c-41f6-a09a-fe0f15392e60 with Priority: HIGHEST for action port [ 573.640022] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4929ed9-ff3c-41f6-a09a-fe0f15392e60 with Priority: HIGHEST for action port [ 573.640547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4929ed9-ff3c-41f6-a09a-fe0f15392e60 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.640648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4929ed9-ff3c-41f6-a09a-fe0f15392e60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.640713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4929ed9-ff3c-41f6-a09a-fe0f15392e60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.640945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4929ed9-ff3c-41f6-a09a-fe0f15392e60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.641064] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4929ed9-ff3c-41f6-a09a-fe0f15392e60',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.097189] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56cbc236-03af-4740-b88f-f6d51019e9d2 [ 574.098443] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.098443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.098443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.098443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.098443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.098443] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56cbc236-03af-4740-b88f-f6d51019e9d2 already deleted. [ 574.098443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56cbc236-03af-4740-b88f-f6d51019e9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.146883] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4929ed9-ff3c-41f6-a09a-fe0f15392e60 [ 574.146883] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.146883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.146883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.146883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.146883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.146883] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4929ed9-ff3c-41f6-a09a-fe0f15392e60 already deleted. [ 574.146883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4929ed9-ff3c-41f6-a09a-fe0f15392e60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.007852] env[65992]: INFO networking_nsxv3.common.synchronization [None req-8c784c45-408a-4f54-86c6-9e2496d99223 None None] Enqueued Resource ID: f4c63019-2e4a-42aa-9428-55ca87e821f8 with Priority: HIGHEST for action port [ 576.008564] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4c63019-2e4a-42aa-9428-55ca87e821f8 with Priority: HIGHEST for action port [ 576.008876] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4c63019-2e4a-42aa-9428-55ca87e821f8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.010402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4c63019-2e4a-42aa-9428-55ca87e821f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.010402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4c63019-2e4a-42aa-9428-55ca87e821f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.010402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4c63019-2e4a-42aa-9428-55ca87e821f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.010402] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4c63019-2e4a-42aa-9428-55ca87e821f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.206852] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e25038e2-85f2-4b1c-bc24-647ce6ed5ae1 None None] Enqueued Resource ID: 814afc76-9ad5-447e-a346-771638f1fa89 with Priority: HIGHEST for action port [ 576.207558] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 814afc76-9ad5-447e-a346-771638f1fa89 with Priority: HIGHEST for action port [ 576.207911] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-814afc76-9ad5-447e-a346-771638f1fa89 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.208097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-814afc76-9ad5-447e-a346-771638f1fa89" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.208675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-814afc76-9ad5-447e-a346-771638f1fa89" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.208675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-814afc76-9ad5-447e-a346-771638f1fa89" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.208675] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('814afc76-9ad5-447e-a346-771638f1fa89',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.511232] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4c63019-2e4a-42aa-9428-55ca87e821f8 [ 576.511463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.511593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.511696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.511877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.511962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.512070] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4c63019-2e4a-42aa-9428-55ca87e821f8 already deleted. [ 576.512150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4c63019-2e4a-42aa-9428-55ca87e821f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.712394] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 814afc76-9ad5-447e-a346-771638f1fa89 [ 576.712625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.712763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.712833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.713056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.713149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.713552] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:814afc76-9ad5-447e-a346-771638f1fa89 already deleted. [ 576.713552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-814afc76-9ad5-447e-a346-771638f1fa89" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.031092] env[65992]: INFO networking_nsxv3.common.synchronization [None req-bb8e02d7-6dc1-4394-bc20-908396a3fd0e None None] Enqueued Resource ID: e6ded361-9e46-4ef8-8419-522c088f8177 with Priority: HIGHEST for action port [ 578.032464] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ded361-9e46-4ef8-8419-522c088f8177 with Priority: HIGHEST for action port [ 578.032796] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6ded361-9e46-4ef8-8419-522c088f8177 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.032990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6ded361-9e46-4ef8-8419-522c088f8177" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.032990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6ded361-9e46-4ef8-8419-522c088f8177" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.033265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6ded361-9e46-4ef8-8419-522c088f8177" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.033423] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6ded361-9e46-4ef8-8419-522c088f8177',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.536417] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6ded361-9e46-4ef8-8419-522c088f8177 [ 578.536653] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.536783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.536849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.537075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.537373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.537373] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6ded361-9e46-4ef8-8419-522c088f8177 already deleted. [ 578.537373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6ded361-9e46-4ef8-8419-522c088f8177" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.301810] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f644e173-96be-4740-b41f-2d84c4285158 None None] Enqueued Resource ID: 422ebd2a-91e0-40ec-a922-12575d8a80f3 with Priority: HIGHEST for action port [ 579.302474] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 422ebd2a-91e0-40ec-a922-12575d8a80f3 with Priority: HIGHEST for action port [ 579.302708] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-422ebd2a-91e0-40ec-a922-12575d8a80f3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.302846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-422ebd2a-91e0-40ec-a922-12575d8a80f3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.302882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-422ebd2a-91e0-40ec-a922-12575d8a80f3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.303114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-422ebd2a-91e0-40ec-a922-12575d8a80f3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.303192] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('422ebd2a-91e0-40ec-a922-12575d8a80f3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.496041] env[65992]: INFO networking_nsxv3.common.synchronization [None req-17518edf-e774-49d8-ae70-002011d0d790 None None] Enqueued Resource ID: 2af657d3-a9a9-4ff0-b41f-956107b1048b with Priority: HIGHEST for action port [ 579.498216] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af657d3-a9a9-4ff0-b41f-956107b1048b with Priority: HIGHEST for action port [ 579.498536] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2af657d3-a9a9-4ff0-b41f-956107b1048b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.498710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2af657d3-a9a9-4ff0-b41f-956107b1048b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.498773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2af657d3-a9a9-4ff0-b41f-956107b1048b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.499706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2af657d3-a9a9-4ff0-b41f-956107b1048b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.499706] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2af657d3-a9a9-4ff0-b41f-956107b1048b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.507767] env[65992]: INFO networking_nsxv3.common.synchronization [None req-8b952ba9-7ab0-4532-9438-722910f2519f None None] Enqueued Resource ID: a6d98349-784b-46de-a596-0a1224f7031a with Priority: HIGHEST for action port [ 579.508765] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6d98349-784b-46de-a596-0a1224f7031a with Priority: HIGHEST for action port [ 579.508765] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6d98349-784b-46de-a596-0a1224f7031a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.508765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6d98349-784b-46de-a596-0a1224f7031a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.508765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6d98349-784b-46de-a596-0a1224f7031a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.508994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6d98349-784b-46de-a596-0a1224f7031a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.508994] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d98349-784b-46de-a596-0a1224f7031a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.805980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 422ebd2a-91e0-40ec-a922-12575d8a80f3 [ 579.806246] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.806453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.806521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.806788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.806903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.806997] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:422ebd2a-91e0-40ec-a922-12575d8a80f3 already deleted. [ 579.807117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-422ebd2a-91e0-40ec-a922-12575d8a80f3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.969997] env[65992]: INFO networking_nsxv3.common.synchronization [None req-781277ed-69ae-4bcb-9d24-6cf9614ac263 None None] Enqueued Resource ID: f04c57d5-a52d-4252-aafc-4f18acc6119f with Priority: HIGHEST for action port [ 579.970272] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f04c57d5-a52d-4252-aafc-4f18acc6119f with Priority: HIGHEST for action port [ 579.970841] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f04c57d5-a52d-4252-aafc-4f18acc6119f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.970965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f04c57d5-a52d-4252-aafc-4f18acc6119f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.971037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f04c57d5-a52d-4252-aafc-4f18acc6119f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.971282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f04c57d5-a52d-4252-aafc-4f18acc6119f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.971362] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f04c57d5-a52d-4252-aafc-4f18acc6119f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.003373] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2af657d3-a9a9-4ff0-b41f-956107b1048b [ 580.003689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.004037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.004037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.004260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.004260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.004378] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2af657d3-a9a9-4ff0-b41f-956107b1048b already deleted. [ 580.004410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2af657d3-a9a9-4ff0-b41f-956107b1048b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.011425] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6d98349-784b-46de-a596-0a1224f7031a [ 580.011640] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.011774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.011858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.013061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.013061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.013061] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6d98349-784b-46de-a596-0a1224f7031a already deleted. [ 580.013061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6d98349-784b-46de-a596-0a1224f7031a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.474497] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f04c57d5-a52d-4252-aafc-4f18acc6119f [ 580.475105] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.475105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.475105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.475337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.475929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.475929] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f04c57d5-a52d-4252-aafc-4f18acc6119f already deleted. [ 580.475929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f04c57d5-a52d-4252-aafc-4f18acc6119f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.874090] env[65992]: INFO networking_nsxv3.common.synchronization [req-d1c8a5aa-b04e-413f-8e30-cdf8e087be5e req-37a7dd8b-818b-41ed-930e-970c89983389 tempest-ServerDiagnosticsNegativeTest-968582946 tempest-ServerDiagnosticsNegativeTest-968582946-project-member] Enqueued Resource ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 with Priority: HIGHEST for action security_group_members [ 580.878015] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 with Priority: HIGHEST for action security_group_members [ 580.878015] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.878015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.878015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.878015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.878015] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.878015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.878015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.878015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.878015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.878015] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06f48e26-5b6b-4a62-b58e-5e3abec6c0c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.381504] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.383285] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.383285] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 already deleted. [ 581.383285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.498034] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.498441] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.498441] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.499700] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.499700] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.499700] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.499700] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.500124] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.500289] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.500724] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 581.500903] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 581.501075] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 581.501244] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 581.504377] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 581.504377] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 581.504377] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 581.521448] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 581.521634] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 581.521790] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 581.521988] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.522885] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-9397fc1b-c28f-4542-8a88-359545714307 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.522885] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-9397fc1b-c28f-4542-8a88-359545714307" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.522885] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-9397fc1b-c28f-4542-8a88-359545714307" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.522885] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-9397fc1b-c28f-4542-8a88-359545714307" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.523340] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9397fc1b-c28f-4542-8a88-359545714307',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.742852] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c35ba6c3-23db-47a7-b472-48a7c95a6e24 None None] Enqueued Resource ID: 302c6e4b-14be-401f-beb5-c461f78af230 with Priority: HIGHEST for action port [ 581.743554] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 302c6e4b-14be-401f-beb5-c461f78af230 with Priority: HIGHEST for action port [ 581.743955] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-302c6e4b-14be-401f-beb5-c461f78af230 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.744098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-302c6e4b-14be-401f-beb5-c461f78af230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.744164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-302c6e4b-14be-401f-beb5-c461f78af230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.744874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-302c6e4b-14be-401f-beb5-c461f78af230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.744874] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('302c6e4b-14be-401f-beb5-c461f78af230',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.028518] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.029611] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.029611] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.029611] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.029611] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.029611] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 9397fc1b-c28f-4542-8a88-359545714307 not found, creating... [ 582.029836] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.029912] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.029995] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.030221] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.030393] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.030775] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.030947] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.033129] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.034261] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.034501] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.034676] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 9397fc1b-c28f-4542-8a88-359545714307 is going to be created. [ 582.064659] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.064659] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.064845] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.064996] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.065302] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.065499] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-9397fc1b-c28f-4542-8a88-359545714307" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.177140] env[65992]: INFO networking_nsxv3.common.synchronization [None req-70217d1a-8faa-46a5-bdd8-354c45b0741f None None] Enqueued Resource ID: f99b96cf-a471-45ad-9c13-3e026b8fd897 with Priority: HIGHEST for action port [ 582.177429] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f99b96cf-a471-45ad-9c13-3e026b8fd897 with Priority: HIGHEST for action port [ 582.178018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f99b96cf-a471-45ad-9c13-3e026b8fd897 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.178147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f99b96cf-a471-45ad-9c13-3e026b8fd897" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.178215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f99b96cf-a471-45ad-9c13-3e026b8fd897" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.178454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f99b96cf-a471-45ad-9c13-3e026b8fd897" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.178540] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f99b96cf-a471-45ad-9c13-3e026b8fd897',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.247672] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 302c6e4b-14be-401f-beb5-c461f78af230 [ 582.247921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.248081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.248400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.248400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.248514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.248846] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:302c6e4b-14be-401f-beb5-c461f78af230 already deleted. [ 582.248950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-302c6e4b-14be-401f-beb5-c461f78af230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.395937] env[65992]: INFO networking_nsxv3.common.synchronization [None req-bfd74fdb-441c-4cdf-8e69-6fe785830862 None None] Enqueued Resource ID: 6a08ed9a-d9c8-4ef9-918a-ff981f65fe83 with Priority: HIGHEST for action port [ 582.396190] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a08ed9a-d9c8-4ef9-918a-ff981f65fe83 with Priority: HIGHEST for action port [ 582.396893] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a08ed9a-d9c8-4ef9-918a-ff981f65fe83 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.397024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a08ed9a-d9c8-4ef9-918a-ff981f65fe83" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.398248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a08ed9a-d9c8-4ef9-918a-ff981f65fe83" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.398318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a08ed9a-d9c8-4ef9-918a-ff981f65fe83" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.398474] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a08ed9a-d9c8-4ef9-918a-ff981f65fe83',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.684023] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f99b96cf-a471-45ad-9c13-3e026b8fd897 [ 582.684023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.684023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.684023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.684023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.684023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.684023] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f99b96cf-a471-45ad-9c13-3e026b8fd897 already deleted. [ 582.684578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f99b96cf-a471-45ad-9c13-3e026b8fd897" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.843945] env[65992]: INFO networking_nsxv3.common.synchronization [req-d1c8a5aa-b04e-413f-8e30-cdf8e087be5e req-04fc5f9b-e708-4f01-a744-0d0a9d54dc79 service nova] Enqueued Resource ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 with Priority: HIGHEST for action security_group_rules [ 582.844140] env[65992]: INFO networking_nsxv3.common.synchronization [req-d1c8a5aa-b04e-413f-8e30-cdf8e087be5e req-04fc5f9b-e708-4f01-a744-0d0a9d54dc79 service nova] Enqueued Resource ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 with Priority: HIGHEST for action security_group_members [ 582.844278] env[65992]: INFO networking_nsxv3.common.synchronization [req-d1c8a5aa-b04e-413f-8e30-cdf8e087be5e req-04fc5f9b-e708-4f01-a744-0d0a9d54dc79 service nova] Enqueued Resource ID: 9397fc1b-c28f-4542-8a88-359545714307 with Priority: HIGHEST for action port [ 582.844853] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 with Priority: HIGHEST for action security_group_rules [ 582.844987] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 with Priority: HIGHEST for action security_group_members [ 582.845096] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9397fc1b-c28f-4542-8a88-359545714307 with Priority: HIGHEST for action port [ 582.845363] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.845484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.845562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.845803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.845884] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06f48e26-5b6b-4a62-b58e-5e3abec6c0c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.847637] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.847764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.847830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.848013] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.848327] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.848327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.848327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.850158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.850158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.851651] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06f48e26-5b6b-4a62-b58e-5e3abec6c0c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.852452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9397fc1b-c28f-4542-8a88-359545714307 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.852578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9397fc1b-c28f-4542-8a88-359545714307" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.852639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9397fc1b-c28f-4542-8a88-359545714307" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.852786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9397fc1b-c28f-4542-8a88-359545714307" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.852876] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9397fc1b-c28f-4542-8a88-359545714307',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.901263] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a08ed9a-d9c8-4ef9-918a-ff981f65fe83 [ 582.901477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.901637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.901712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.901932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.902032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.902118] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a08ed9a-d9c8-4ef9-918a-ff981f65fe83 already deleted. [ 582.902200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a08ed9a-d9c8-4ef9-918a-ff981f65fe83" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.912241] env[65992]: INFO networking_nsxv3.common.synchronization [req-cae6e33a-b363-4969-9de7-8de4bd359ce3 req-decdf6cd-08ba-4995-8f2e-7cf86a043e11 tempest-ServerDiagnosticsTest-587959288 tempest-ServerDiagnosticsTest-587959288-project-member] Enqueued Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGHEST for action security_group_members [ 582.916075] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGHEST for action security_group_members [ 582.916075] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.916075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.916075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.916299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.916413] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.916542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.916606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.916765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.916875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.917033] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.348502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.349021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.356987] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06f48e26-5b6b-4a62-b58e-5e3abec6c0c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.364816] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9397fc1b-c28f-4542-8a88-359545714307 with status ACTIVE [ 583.366727] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.367093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.367093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.367345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.367492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.368178] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.368352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.368445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.368708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.368708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.369089] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.369227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.369407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.369540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.369638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.369744] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9397fc1b-c28f-4542-8a88-359545714307 is going to be updated. [ 583.394140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.394545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.394545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.395102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.395102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.395102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9397fc1b-c28f-4542-8a88-359545714307" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.419343] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.419779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.419779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.419993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.419993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.420839] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.421031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.421117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.421322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.421639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.421741] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b already deleted. [ 583.421856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.519375] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.519585] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.519889] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.519963] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.520226] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.520370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.520479] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.520680] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.520813] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.521129] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.521129] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.521217] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.521318] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.521419] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.521529] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.521652] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.540540] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.540703] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 583.540824] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.540992] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.541313] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.541480] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.541600] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.541924] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.542068] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.558793] env[65992]: INFO networking_nsxv3.common.synchronization [None req-316bd22c-6996-440a-a1cc-0e7ae37f96ac None None] Enqueued Resource ID: 3cc9d743-52f0-469c-b949-12989b0f54f0 with Priority: HIGHEST for action port [ 583.559060] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc9d743-52f0-469c-b949-12989b0f54f0 with Priority: HIGHEST for action port [ 583.559575] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cc9d743-52f0-469c-b949-12989b0f54f0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.559702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cc9d743-52f0-469c-b949-12989b0f54f0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.559769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cc9d743-52f0-469c-b949-12989b0f54f0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.559991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cc9d743-52f0-469c-b949-12989b0f54f0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.560083] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cc9d743-52f0-469c-b949-12989b0f54f0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.860181] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06f48e26-5b6b-4a62-b58e-5e3abec6c0c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.046723] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.046723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.046723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.046723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.046723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.046723] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5 not found, creating... [ 584.046723] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.046723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.046723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.046723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.046723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.047268] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.047423] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.047703] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.048150] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.048465] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.048743] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5 is going to be created. [ 584.062442] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cc9d743-52f0-469c-b949-12989b0f54f0 [ 584.062442] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.062442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.062652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.063748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.063748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.063748] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cc9d743-52f0-469c-b949-12989b0f54f0 already deleted. [ 584.063944] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cc9d743-52f0-469c-b949-12989b0f54f0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.070705] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.072127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.072127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.072127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.072127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.072127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.363541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.363706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.363777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.364319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.364319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.364431] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 is going to be created. [ 584.395463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.395587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.395621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.396316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.396316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.405672] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 in Status: UNINITIALIZED for 2s [ 584.803915] env[65992]: INFO networking_nsxv3.common.synchronization [req-cae6e33a-b363-4969-9de7-8de4bd359ce3 req-725ab2cb-665c-42eb-bff1-d15c4235dcc5 service nova] Enqueued Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGHEST for action security_group_rules [ 584.803915] env[65992]: INFO networking_nsxv3.common.synchronization [req-cae6e33a-b363-4969-9de7-8de4bd359ce3 req-725ab2cb-665c-42eb-bff1-d15c4235dcc5 service nova] Enqueued Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGHEST for action security_group_members [ 584.803915] env[65992]: INFO networking_nsxv3.common.synchronization [req-cae6e33a-b363-4969-9de7-8de4bd359ce3 req-725ab2cb-665c-42eb-bff1-d15c4235dcc5 service nova] Enqueued Resource ID: 56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5 with Priority: HIGHEST for action port [ 584.803915] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGHEST for action security_group_rules [ 584.803915] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGHEST for action security_group_members [ 584.803915] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5 with Priority: HIGHEST for action port [ 584.803915] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.803915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.803915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.804696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.804941] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.808059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.808059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.808059] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.808059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.808059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.808663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.808784] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.312641] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.312641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.312884] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.322166] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5 with status ACTIVE [ 585.322583] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.323187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.323187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.323187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.323187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.323782] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.323923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.324852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.324852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.324969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.325506] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.325506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.325506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.325506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.325692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.325692] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5 is going to be updated. [ 585.350214] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.350214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.350214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.350214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.350214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.350214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56a89ad7-2b4d-4ae8-bafe-b5950c4a4ee5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.495373] env[65992]: INFO networking_nsxv3.common.synchronization [req-d78d3b1e-b44c-44a0-b056-f677981fe1ec req-d776c9ae-12ba-45f2-ac39-e8c7ec7a57ac tempest-DeleteServersAdminTestJSON-1602258422 tempest-DeleteServersAdminTestJSON-1602258422-project-member] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 585.496595] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 585.496983] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.497593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.497593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.497737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.497814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.498948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.498948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.498948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.498948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.498948] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.817985] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.896564] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.896827] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.896827] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.897072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.897310] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.897450] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.898615] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.898615] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.898615] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.898615] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.898615] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.898615] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.899115] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.899115] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.899115] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.899218] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.925025] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.925025] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 585.925025] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.925025] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.925025] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.925025] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.925025] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.925025] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.925550] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c77abfa2-7a53-4cfc-af29-8a80fcf010ef',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.001581] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.001739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.001806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.002135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.002242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.002476] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.002588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.002730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.002823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.002900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.002984] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f already deleted. [ 586.003224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.110201] env[65992]: INFO networking_nsxv3.common.synchronization [None req-10e1aea6-17c8-451f-abf0-f00878a4d74d None None] Enqueued Resource ID: 54973b9e-4b87-4e97-ab51-26061b843506 with Priority: HIGHEST for action port [ 586.110201] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54973b9e-4b87-4e97-ab51-26061b843506 with Priority: HIGHEST for action port [ 586.110201] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-54973b9e-4b87-4e97-ab51-26061b843506 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.110201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54973b9e-4b87-4e97-ab51-26061b843506" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.110201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54973b9e-4b87-4e97-ab51-26061b843506" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.110504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54973b9e-4b87-4e97-ab51-26061b843506" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.110671] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54973b9e-4b87-4e97-ab51-26061b843506',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.322104] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.322380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.322380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.322580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.322613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.322691] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b is going to be created. [ 586.350404] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.350554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.350654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.350813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.354119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.363395] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b in Status: UNINITIALIZED for 2s [ 586.418378] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 in Status: SUCCESS [ 586.418597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.419412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.419412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.419412] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.419412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.419412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.419837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.419837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.419837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.419837] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06f48e26-5b6b-4a62-b58e-5e3abec6c0c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.428563] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.428800] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.428926] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.429191] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.429327] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.429480] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port c77abfa2-7a53-4cfc-af29-8a80fcf010ef not found, creating... [ 586.429727] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.429853] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.429958] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.430168] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.430481] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.430792] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.430964] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.431088] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.431315] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.431529] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.431670] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: c77abfa2-7a53-4cfc-af29-8a80fcf010ef is going to be created. [ 586.453167] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.453167] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.453446] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.453510] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.453729] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.454168] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.613815] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54973b9e-4b87-4e97-ab51-26061b843506 [ 586.613815] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.613815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.613815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.613815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.613815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.613815] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54973b9e-4b87-4e97-ab51-26061b843506 already deleted. [ 586.613815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54973b9e-4b87-4e97-ab51-26061b843506" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.922801] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.923040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.923659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.923659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.923659] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.923659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.923659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.923916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.923916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.923972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.924086] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.924179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.924237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.924438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.924568] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.924641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.924700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.924835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.924909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.924986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.925226] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06f48e26-5b6b-4a62-b58e-5e3abec6c0c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.165349] env[65992]: INFO networking_nsxv3.common.synchronization [req-d78d3b1e-b44c-44a0-b056-f677981fe1ec req-9c792d52-2926-4b20-89c7-cf8d788365d2 service nova] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_rules [ 587.165532] env[65992]: INFO networking_nsxv3.common.synchronization [req-d78d3b1e-b44c-44a0-b056-f677981fe1ec req-9c792d52-2926-4b20-89c7-cf8d788365d2 service nova] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 587.165662] env[65992]: INFO networking_nsxv3.common.synchronization [req-d78d3b1e-b44c-44a0-b056-f677981fe1ec req-9c792d52-2926-4b20-89c7-cf8d788365d2 service nova] Enqueued Resource ID: c77abfa2-7a53-4cfc-af29-8a80fcf010ef with Priority: HIGHEST for action port [ 587.165884] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_rules [ 587.166016] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 587.166120] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77abfa2-7a53-4cfc-af29-8a80fcf010ef with Priority: HIGHEST for action port [ 587.166769] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.166946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.166984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.167419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.167476] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.168339] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.168458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.168525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.168702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.168845] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.168940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.169008] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.169182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.169228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.169312] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.170918] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.171045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.171114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.171378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.171456] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c77abfa2-7a53-4cfc-af29-8a80fcf010ef',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.427820] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9: rpc.has_security_group_logging(os_id): False [ 587.448127] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.448127] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.448127] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.448127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.448601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.448601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.448601] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.448601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.448753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.448753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.448828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.448913] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 is going to be created. [ 587.509400] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.509732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.509844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.510094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.510952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.522447] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 in Status: IN_PROGRESS for 2s [ 587.549131] env[65992]: INFO networking_nsxv3.common.synchronization [None req-984bf29f-910b-494b-81eb-0258fcf2ca13 None None] Enqueued Resource ID: ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d with Priority: HIGHEST for action port [ 587.549746] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d with Priority: HIGHEST for action port [ 587.550078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.550254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.550254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.550566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.550783] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.671769] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.673529] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c77abfa2-7a53-4cfc-af29-8a80fcf010ef with status ACTIVE [ 587.673766] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.673891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.673961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.674197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.674288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.674496] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.674599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.674700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.674871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.674948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.675204] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.675306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.675366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.675509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.675581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.675663] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c77abfa2-7a53-4cfc-af29-8a80fcf010ef is going to be updated. [ 587.676956] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.677079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.698872] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.699951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.699951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.699951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.699951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.700153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c77abfa2-7a53-4cfc-af29-8a80fcf010ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.055085] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d [ 588.055085] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.055382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.055382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.056084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.056084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.056084] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d already deleted. [ 588.056084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca52a7d4-19fd-4f9b-aa08-a28d4bd5855d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.174523] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.265051] env[65992]: INFO networking_nsxv3.common.synchronization [req-41ffbf34-5091-4dfd-9cb6-3b71629eb625 req-b46220a5-26a0-4c64-a25a-2e834adceb2f tempest-ServersAdminTestJSON-561694848 tempest-ServersAdminTestJSON-561694848-project-member] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 588.265650] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 588.266331] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.266485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.266556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.266791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.266948] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.267313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.267452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.267579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.267722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.267767] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.375240] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b in Status: SUCCESS [ 588.375240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.375240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.376195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.376195] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.376195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.376195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.377103] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.379614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.379614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.379614] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.678781] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.679102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.679102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.679193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.679281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.679379] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f is going to be created. [ 588.705167] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.705340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.705460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.705578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.705730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.717393] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: UNINITIALIZED for 2s [ 588.770760] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.771045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.771045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.771230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.771349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.771612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.771751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.771838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.772593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.772716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.772851] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 already deleted. [ 588.772946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.883255] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.883255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.883415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.883653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.887018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.887018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.887018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.887018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.887018] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.920831] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-652 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.920831] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.921054] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.921237] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.921532] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.922161] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.922161] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.922443] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.924241] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.925025] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.925025] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.926355] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.926355] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.926355] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.926355] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.926355] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.954993] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.955169] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 588.955298] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.955475] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.955825] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.955990] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.956136] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.956476] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.956616] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.094692] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c8fe6e95-38a1-46a0-bd4b-0485ea7d4bd6 tempest-VolumesAssistedSnapshotsTest-699681554 tempest-VolumesAssistedSnapshotsTest-699681554-project-member] Enqueued Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_rules [ 589.096079] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_rules [ 589.096079] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5ce6400-2109-4c84-b2da-30e330c81a70 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.096390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.096390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.096541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.096541] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.380319] env[65992]: INFO networking_nsxv3.common.synchronization [None req-4bc2e9c7-9c02-45f1-95bc-5d9f5f9347be None None] Enqueued Resource ID: 023e12e3-a7f1-41a1-90a3-131c0d7862c5 with Priority: HIGHEST for action port [ 589.380319] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023e12e3-a7f1-41a1-90a3-131c0d7862c5 with Priority: HIGHEST for action port [ 589.380319] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-023e12e3-a7f1-41a1-90a3-131c0d7862c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.380319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-023e12e3-a7f1-41a1-90a3-131c0d7862c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.380319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-023e12e3-a7f1-41a1-90a3-131c0d7862c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.380319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-023e12e3-a7f1-41a1-90a3-131c0d7862c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.380319] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023e12e3-a7f1-41a1-90a3-131c0d7862c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.388977] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b: rpc.has_security_group_logging(os_id): False [ 589.408824] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.408970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.409049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.409262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.409344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.409545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.409665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.409754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.409907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.409978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.410194] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.410849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.410849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.410849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.410849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.411052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.411052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.411782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.411782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.411782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.411782] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b is going to be created. [ 589.460721] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.461202] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.461392] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.461950] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.462457] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.462694] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31 not found, creating... [ 589.463198] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.463640] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.463847] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.464193] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.464351] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.464732] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.465090] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.465161] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.465393] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.465659] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.465783] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31 is going to be created. [ 589.470802] env[65992]: INFO networking_nsxv3.common.synchronization [None req-37f66ce4-47da-4cd8-afd1-7b5f2909c423 tempest-VolumesAssistedSnapshotsTest-699681554 tempest-VolumesAssistedSnapshotsTest-699681554-project-member] Enqueued Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_rules [ 589.472920] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_rules [ 589.473843] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5ce6400-2109-4c84-b2da-30e330c81a70 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.474059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.479736] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.479984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.480141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.480391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.480732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.494571] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b in Status: IN_PROGRESS for 2s [ 589.499610] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.499853] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.499853] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.500091] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.500277] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.500491] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.540122] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 in Status: SUCCESS [ 589.540835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.632176] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.632809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.632809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.633105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.633294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.633294] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5ce6400-2109-4c84-b2da-30e330c81a70 already deleted. [ 589.633384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.633534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.633970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.634020] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.881852] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 023e12e3-a7f1-41a1-90a3-131c0d7862c5 [ 589.881852] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.882209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.882209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.882275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.882354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.882465] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:023e12e3-a7f1-41a1-90a3-131c0d7862c5 already deleted. [ 589.882573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-023e12e3-a7f1-41a1-90a3-131c0d7862c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.158621] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.158758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.158842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.159127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.159127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.159286] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5ce6400-2109-4c84-b2da-30e330c81a70 already deleted. [ 590.159286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.623298] env[65992]: INFO networking_nsxv3.common.synchronization [req-41ffbf34-5091-4dfd-9cb6-3b71629eb625 req-fbd9d761-5354-47fe-b609-aab056306908 service nova] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_rules [ 590.623620] env[65992]: INFO networking_nsxv3.common.synchronization [req-41ffbf34-5091-4dfd-9cb6-3b71629eb625 req-fbd9d761-5354-47fe-b609-aab056306908 service nova] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 590.623620] env[65992]: INFO networking_nsxv3.common.synchronization [req-41ffbf34-5091-4dfd-9cb6-3b71629eb625 req-fbd9d761-5354-47fe-b609-aab056306908 service nova] Enqueued Resource ID: 0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31 with Priority: HIGHEST for action port [ 590.623857] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_rules [ 590.623982] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 590.624117] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31 with Priority: HIGHEST for action port [ 590.624848] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.624848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.625017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.625333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.625372] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.626768] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.626899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.626977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.627167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.627318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.627420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.627497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.627667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.627809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.627809] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.628955] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.629141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.629221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.629441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.629441] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.728558] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: SUCCESS [ 590.728797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.728916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.729147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.729335] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.729454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.729525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.729687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.729765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.729848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.729934] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.129323] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.129323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.129679] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.134735] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31 with status ACTIVE [ 591.134906] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.135056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.135123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.135331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.135418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.135689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.135789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.135866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.136014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.136128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.136308] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.136396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.136543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.136703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.136778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.136936] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31 is going to be updated. [ 591.164672] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.164854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.164854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.165048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.165185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.165342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b53b0e4-5b9e-4cc7-83b7-5b0ac18fff31" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.232470] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.232470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.232470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.232470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.232773] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.232773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.232773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.232773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.232960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.232960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.233087] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.233178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.233234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.233368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.233506] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.233592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.233647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.233776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.233845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.234615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.234615] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.508221] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b in Status: SUCCESS [ 591.508549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.562322] env[65992]: INFO networking_nsxv3.common.synchronization [req-401ecd23-5db0-4065-b4da-c145dc405793 req-39bdfe50-f3fe-4dd8-8ef4-7a4f7a2bfbdc tempest-ServerExternalEventsTest-214952409 tempest-ServerExternalEventsTest-214952409-project-member] Enqueued Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGHEST for action security_group_members [ 591.562974] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGHEST for action security_group_members [ 591.563139] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.563353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.563441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.563725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.563896] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.564110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.565655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.566146] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.566146] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.566146] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.631566] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.737409] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76f6dffd-94d6-4a01-8082-da146608e51f: rpc.has_security_group_logging(os_id): False [ 591.755497] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.755663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.755711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.755910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.755987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.756217] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.756305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.756451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.756562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.756710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.756808] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.756903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.756960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.757096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.757166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.757349] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.757426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.757486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.757853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.757926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.757986] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f is going to be created. [ 591.819761] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.819975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.820119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.820469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.820656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.833198] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: IN_PROGRESS for 2s [ 591.921314] env[65992]: INFO networking_nsxv3.common.synchronization [None req-54eb6ed9-c35f-4974-b508-bd301bcce988 None None] Enqueued Resource ID: 1d024b2f-a4f8-453c-9fbc-eec1a4e10260 with Priority: HIGHEST for action port [ 591.921872] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d024b2f-a4f8-453c-9fbc-eec1a4e10260 with Priority: HIGHEST for action port [ 591.921946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d024b2f-a4f8-453c-9fbc-eec1a4e10260 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.922261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d024b2f-a4f8-453c-9fbc-eec1a4e10260" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.922342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d024b2f-a4f8-453c-9fbc-eec1a4e10260" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.923642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d024b2f-a4f8-453c-9fbc-eec1a4e10260" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.923642] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d024b2f-a4f8-453c-9fbc-eec1a4e10260',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.069541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.069724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.069789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.070491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.070491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.070491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.070491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.070491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.070823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.070823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.070823] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 already deleted. [ 592.070908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.133528] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.133819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.133819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.135288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.135288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.135288] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be created. [ 592.165130] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.165344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.165344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.165572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.165720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.177083] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: UNINITIALIZED for 2s [ 592.424458] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d024b2f-a4f8-453c-9fbc-eec1a4e10260 [ 592.424679] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.424812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.424873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.425152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.425244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.425337] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d024b2f-a4f8-453c-9fbc-eec1a4e10260 already deleted. [ 592.425423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d024b2f-a4f8-453c-9fbc-eec1a4e10260" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.799276] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.799276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.799276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.799276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.799276] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.799276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.799276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.799276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.799276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.800409] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.800667] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.800874] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.801083] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.801287] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.801498] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.801719] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.823171] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.823171] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.823171] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.823171] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.823171] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-28840d4d-a792-4471-89e7-99bcaca60e2b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.823540] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-28840d4d-a792-4471-89e7-99bcaca60e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.823540] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-28840d4d-a792-4471-89e7-99bcaca60e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.824412] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-28840d4d-a792-4471-89e7-99bcaca60e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.824412] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28840d4d-a792-4471-89e7-99bcaca60e2b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.327271] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.327967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.327967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.327967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.329417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.329417] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 28840d4d-a792-4471-89e7-99bcaca60e2b not found, creating... [ 593.329417] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.329417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.329417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.329417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.329417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.329417] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.329697] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.329697] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.329848] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.329935] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.330697] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 28840d4d-a792-4471-89e7-99bcaca60e2b is going to be created. [ 593.352278] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.353143] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.353282] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.356957] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.356957] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.356957] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-28840d4d-a792-4471-89e7-99bcaca60e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.366347] env[65992]: INFO networking_nsxv3.common.synchronization [None req-dd5d7056-dbbd-47c0-8230-d3aa8b9a6331 None None] Enqueued Resource ID: b441cd48-0c67-47f4-b867-3b13f396e8e2 with Priority: HIGHEST for action port [ 593.366347] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b441cd48-0c67-47f4-b867-3b13f396e8e2 with Priority: HIGHEST for action port [ 593.366347] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-b441cd48-0c67-47f4-b867-3b13f396e8e2 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.366347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b441cd48-0c67-47f4-b867-3b13f396e8e2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.366347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b441cd48-0c67-47f4-b867-3b13f396e8e2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.366645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b441cd48-0c67-47f4-b867-3b13f396e8e2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.366645] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b441cd48-0c67-47f4-b867-3b13f396e8e2',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.846896] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: SUCCESS [ 593.847360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.869716] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b441cd48-0c67-47f4-b867-3b13f396e8e2 [ 593.870041] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.870199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.870291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.870487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.870625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.870771] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b441cd48-0c67-47f4-b867-3b13f396e8e2 already deleted. [ 593.870827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b441cd48-0c67-47f4-b867-3b13f396e8e2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.152673] env[65992]: INFO networking_nsxv3.common.synchronization [req-401ecd23-5db0-4065-b4da-c145dc405793 req-82b3e444-878e-4ee6-af6d-2dcf3bc45263 service nova] Enqueued Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGHEST for action security_group_rules [ 594.152673] env[65992]: INFO networking_nsxv3.common.synchronization [req-401ecd23-5db0-4065-b4da-c145dc405793 req-82b3e444-878e-4ee6-af6d-2dcf3bc45263 service nova] Enqueued Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGHEST for action security_group_members [ 594.152673] env[65992]: INFO networking_nsxv3.common.synchronization [req-401ecd23-5db0-4065-b4da-c145dc405793 req-82b3e444-878e-4ee6-af6d-2dcf3bc45263 service nova] Enqueued Resource ID: 28840d4d-a792-4471-89e7-99bcaca60e2b with Priority: HIGHEST for action port [ 594.152928] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGHEST for action security_group_rules [ 594.153086] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGHEST for action security_group_members [ 594.153188] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28840d4d-a792-4471-89e7-99bcaca60e2b with Priority: HIGHEST for action port [ 594.153453] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.153575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.153642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.157352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.157492] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.159417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.159417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.159417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.159417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.159417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.159417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.159417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.159721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.159721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.159849] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.161376] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-28840d4d-a792-4471-89e7-99bcaca60e2b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.161723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28840d4d-a792-4471-89e7-99bcaca60e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.161723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28840d4d-a792-4471-89e7-99bcaca60e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.164453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28840d4d-a792-4471-89e7-99bcaca60e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.164453] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28840d4d-a792-4471-89e7-99bcaca60e2b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.187806] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 594.187929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.188383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.188599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.188795] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.188916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.188977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.189141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.189221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.189306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.189396] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.324674] env[65992]: INFO networking_nsxv3.common.synchronization [None req-ddd37a90-d4a9-4230-aaa9-4be85a261fc3 None None] Enqueued Resource ID: eec602cd-d6bc-458c-af1b-ba65a0566097 with Priority: HIGHEST for action port [ 594.325370] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eec602cd-d6bc-458c-af1b-ba65a0566097 with Priority: HIGHEST for action port [ 594.325370] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-eec602cd-d6bc-458c-af1b-ba65a0566097 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.325608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eec602cd-d6bc-458c-af1b-ba65a0566097" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.325608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eec602cd-d6bc-458c-af1b-ba65a0566097" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.326224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eec602cd-d6bc-458c-af1b-ba65a0566097" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.326224] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eec602cd-d6bc-458c-af1b-ba65a0566097',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.663249] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.664322] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.664448] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.664839] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28840d4d-a792-4471-89e7-99bcaca60e2b with status ACTIVE [ 594.665081] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.665204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.666030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.666030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.666030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.666030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.666030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.666030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.666030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.666691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.666941] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.667080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.667149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.667310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.667387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.667498] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28840d4d-a792-4471-89e7-99bcaca60e2b is going to be updated. [ 594.691894] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.692128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.692128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.692352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.692528] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.692627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.692683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.692854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.692915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.692986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.693142] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.693233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.693289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.693428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.693561] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.693648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.693698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.693845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.693970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.694031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.694169] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.698373] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.698468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.698545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.699911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.699911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.699911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28840d4d-a792-4471-89e7-99bcaca60e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.829791] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eec602cd-d6bc-458c-af1b-ba65a0566097 [ 594.830903] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.830903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.830903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.830903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.830903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.830903] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eec602cd-d6bc-458c-af1b-ba65a0566097 already deleted. [ 594.830903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eec602cd-d6bc-458c-af1b-ba65a0566097" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.166988] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.196812] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f9dacc-af29-4b40-93c8-17d4f636d125: rpc.has_security_group_logging(os_id): False [ 595.218313] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.218313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.218313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.218604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.218604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.219564] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.219564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.219564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.220545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.220545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.220545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.221015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.221092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.221242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.221315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.221512] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.221609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.221668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.221806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.221873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.224146] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be created. [ 595.288981] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.288981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.288981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.289209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.289369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.304856] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 595.508793] env[65992]: INFO networking_nsxv3.common.synchronization [None req-7186756a-9b79-4efa-953d-6c62029b95a6 None None] Enqueued Resource ID: 24c16446-e9aa-4070-9479-a120a4f79bd3 with Priority: HIGHEST for action port [ 595.508793] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c16446-e9aa-4070-9479-a120a4f79bd3 with Priority: HIGHEST for action port [ 595.508793] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-24c16446-e9aa-4070-9479-a120a4f79bd3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.508793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24c16446-e9aa-4070-9479-a120a4f79bd3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.508793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24c16446-e9aa-4070-9479-a120a4f79bd3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.508793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24c16446-e9aa-4070-9479-a120a4f79bd3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.509034] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24c16446-e9aa-4070-9479-a120a4f79bd3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.669801] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.670748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.670860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.671299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.671299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.671400] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 is going to be created. [ 595.702992] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.702992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.702992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.702992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.702992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.711981] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 in Status: UNINITIALIZED for 2s [ 596.008685] env[65992]: INFO networking_nsxv3.common.synchronization [req-8fc88ec4-7a26-48a4-9a76-6f68a541f59d req-4efff7dd-fcb9-4af1-a99b-1d3e2ba812e3 tempest-ServerAddressesNegativeTestJSON-765852989 tempest-ServerAddressesNegativeTestJSON-765852989-project-member] Enqueued Resource ID: 308a2531-7733-489b-8a70-8bf49437f735 with Priority: HIGHEST for action security_group_members [ 596.009060] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 308a2531-7733-489b-8a70-8bf49437f735 with Priority: HIGHEST for action security_group_members [ 596.009383] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-308a2531-7733-489b-8a70-8bf49437f735 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.009510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.009579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.009837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.010010] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.011406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.011406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.011562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.011634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.011743] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('308a2531-7733-489b-8a70-8bf49437f735',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.013822] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24c16446-e9aa-4070-9479-a120a4f79bd3 [ 596.014073] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.014219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.014287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.015012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.015012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.015012] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24c16446-e9aa-4070-9479-a120a4f79bd3 already deleted. [ 596.015012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24c16446-e9aa-4070-9479-a120a4f79bd3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.050583] env[65992]: INFO networking_nsxv3.common.synchronization [None req-408a9e11-7637-4bf1-8bd8-c47ead4c8d93 None None] Enqueued Resource ID: 8da04b7c-f8d6-4050-9940-ea5e0202eab6 with Priority: HIGHEST for action port [ 596.051129] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8da04b7c-f8d6-4050-9940-ea5e0202eab6 with Priority: HIGHEST for action port [ 596.051446] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-8da04b7c-f8d6-4050-9940-ea5e0202eab6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.051572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8da04b7c-f8d6-4050-9940-ea5e0202eab6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.051647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8da04b7c-f8d6-4050-9940-ea5e0202eab6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.051914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8da04b7c-f8d6-4050-9940-ea5e0202eab6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.052019] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8da04b7c-f8d6-4050-9940-ea5e0202eab6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.291304] env[65992]: INFO networking_nsxv3.common.synchronization [None req-9a7d65af-645f-4c7b-93ed-85bbe25d724c None None] Enqueued Resource ID: 4e8a551f-a77b-4c5d-b820-68cd2035a3cf with Priority: HIGHEST for action port [ 596.292288] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e8a551f-a77b-4c5d-b820-68cd2035a3cf with Priority: HIGHEST for action port [ 596.292522] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e8a551f-a77b-4c5d-b820-68cd2035a3cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.292775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e8a551f-a77b-4c5d-b820-68cd2035a3cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.292775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e8a551f-a77b-4c5d-b820-68cd2035a3cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.292979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e8a551f-a77b-4c5d-b820-68cd2035a3cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.293086] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e8a551f-a77b-4c5d-b820-68cd2035a3cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.517941] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.517941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.517941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.518380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.518380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.518661] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.518734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.518845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.519150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.519358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.519610] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 308a2531-7733-489b-8a70-8bf49437f735 already deleted. [ 596.519769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.557454] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8da04b7c-f8d6-4050-9940-ea5e0202eab6 [ 596.557703] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.557822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.557890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.558270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.558270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.558418] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8da04b7c-f8d6-4050-9940-ea5e0202eab6 already deleted. [ 596.558733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8da04b7c-f8d6-4050-9940-ea5e0202eab6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.795661] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e8a551f-a77b-4c5d-b820-68cd2035a3cf [ 596.796022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.796120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.796120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.796343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.796432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.796552] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e8a551f-a77b-4c5d-b820-68cd2035a3cf already deleted. [ 596.796645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e8a551f-a77b-4c5d-b820-68cd2035a3cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.805595] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.805819] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.805958] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.806305] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.806635] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.806891] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.806971] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.808669] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.808865] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.809119] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.809267] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.809383] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.809490] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.809609] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.809713] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.809868] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.834377] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.834377] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.834377] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.834377] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.834377] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.834377] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.834377] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.834377] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.835441] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d75ed43-93c4-43df-b0ef-cdea8d9dcf68',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.322309] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 597.322574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.338124] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.338359] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.338476] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.338756] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.338993] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.339164] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 1d75ed43-93c4-43df-b0ef-cdea8d9dcf68 not found, creating... [ 597.339423] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.339576] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.339687] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.339909] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.340050] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.340321] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.340467] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.340574] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.340774] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.340893] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.341028] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 1d75ed43-93c4-43df-b0ef-cdea8d9dcf68 is going to be created. [ 597.364771] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.365054] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.365242] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.365576] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.365980] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.366278] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.682032] env[65992]: INFO networking_nsxv3.common.synchronization [req-7d6dec2b-c572-448c-b59e-be3679faf13a req-283c3129-9a12-4276-bb84-a5b3a53b4dd2 tempest-ServersAdminTestJSON-561694848 tempest-ServersAdminTestJSON-561694848-project-member] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 597.682573] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 597.682867] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.682990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.683100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.683316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.683594] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.683720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.683789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.683970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.684092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.684190] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.724023] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 in Status: SUCCESS [ 597.724962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.724962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.724962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.725162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.725230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.725266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.725438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.725511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.725595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.725682] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.016339] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-652 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.017332] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.017332] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.017332] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.017332] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.017332] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.017980] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.017980] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.017980] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.017980] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.018132] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.018132] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.018218] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.018303] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.018400] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.018522] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.043741] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.044014] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.044228] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.044364] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.044738] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-fef5d78d-1962-407f-8fca-1f607ff5d66f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.044968] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-fef5d78d-1962-407f-8fca-1f607ff5d66f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.044968] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-fef5d78d-1962-407f-8fca-1f607ff5d66f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.045327] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-fef5d78d-1962-407f-8fca-1f607ff5d66f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.045494] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef5d78d-1962-407f-8fca-1f607ff5d66f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.071428] env[65992]: INFO networking_nsxv3.common.synchronization [req-8fc88ec4-7a26-48a4-9a76-6f68a541f59d req-2c474abf-96f3-4b4b-95a9-98c70ca390aa service nova] Enqueued Resource ID: 308a2531-7733-489b-8a70-8bf49437f735 with Priority: HIGHEST for action security_group_rules [ 598.071597] env[65992]: INFO networking_nsxv3.common.synchronization [req-8fc88ec4-7a26-48a4-9a76-6f68a541f59d req-2c474abf-96f3-4b4b-95a9-98c70ca390aa service nova] Enqueued Resource ID: 308a2531-7733-489b-8a70-8bf49437f735 with Priority: HIGHEST for action security_group_members [ 598.071729] env[65992]: INFO networking_nsxv3.common.synchronization [req-8fc88ec4-7a26-48a4-9a76-6f68a541f59d req-2c474abf-96f3-4b4b-95a9-98c70ca390aa service nova] Enqueued Resource ID: 1d75ed43-93c4-43df-b0ef-cdea8d9dcf68 with Priority: HIGHEST for action port [ 598.072305] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 308a2531-7733-489b-8a70-8bf49437f735 with Priority: HIGHEST for action security_group_rules [ 598.072445] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 308a2531-7733-489b-8a70-8bf49437f735 with Priority: HIGHEST for action security_group_members [ 598.072544] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d75ed43-93c4-43df-b0ef-cdea8d9dcf68 with Priority: HIGHEST for action port [ 598.072814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-308a2531-7733-489b-8a70-8bf49437f735 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.072939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.073018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.073324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.073390] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('308a2531-7733-489b-8a70-8bf49437f735',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.074335] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-308a2531-7733-489b-8a70-8bf49437f735 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.074335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.074335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.074561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.074735] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.075160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.075228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.075405] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.075462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.075552] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('308a2531-7733-489b-8a70-8bf49437f735',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.076275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.076583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.076583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.076743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.076838] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d75ed43-93c4-43df-b0ef-cdea8d9dcf68',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.187459] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.231565] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.231565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.231565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.231565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.231565] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.231565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.231565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.231565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.231565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.231565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.236027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.236027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.236027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.236027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.236027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.236027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.236027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.236027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.236027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.236027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.236027] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.279364] env[65992]: INFO networking_nsxv3.common.synchronization [None req-93a13b8a-17b1-4f07-9825-65df754c479b None None] Enqueued Resource ID: 223d3f15-b4c4-4d69-81b7-f40d2da399d2 with Priority: HIGHEST for action port [ 598.279364] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 223d3f15-b4c4-4d69-81b7-f40d2da399d2 with Priority: HIGHEST for action port [ 598.280211] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-223d3f15-b4c4-4d69-81b7-f40d2da399d2 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.280602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-223d3f15-b4c4-4d69-81b7-f40d2da399d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.280783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-223d3f15-b4c4-4d69-81b7-f40d2da399d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.281158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-223d3f15-b4c4-4d69-81b7-f40d2da399d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.281382] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('223d3f15-b4c4-4d69-81b7-f40d2da399d2',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.342771] env[65992]: INFO networking_nsxv3.common.synchronization [None req-fedb2b5d-27da-4d4e-8ff2-463d53ce8ca5 None None] Enqueued Resource ID: 8640d5e9-b68a-425b-a6e6-aa1b2b67c66a with Priority: HIGHEST for action port [ 598.343681] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8640d5e9-b68a-425b-a6e6-aa1b2b67c66a with Priority: HIGHEST for action port [ 598.344495] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-8640d5e9-b68a-425b-a6e6-aa1b2b67c66a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.344760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8640d5e9-b68a-425b-a6e6-aa1b2b67c66a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.344834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8640d5e9-b68a-425b-a6e6-aa1b2b67c66a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.346038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8640d5e9-b68a-425b-a6e6-aa1b2b67c66a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.346038] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8640d5e9-b68a-425b-a6e6-aa1b2b67c66a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.547990] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.548283] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.548597] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.548989] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.549090] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.549264] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port fef5d78d-1962-407f-8fca-1f607ff5d66f not found, creating... [ 598.549577] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.549949] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.549949] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.550116] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.550249] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.550523] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.550673] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.550914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.550973] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.551251] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.551463] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: fef5d78d-1962-407f-8fca-1f607ff5d66f is going to be created. [ 598.574024] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.574258] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.574371] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.574640] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.574860] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.575112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-fef5d78d-1962-407f-8fca-1f607ff5d66f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.578690] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-308a2531-7733-489b-8a70-8bf49437f735 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.578874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.579115] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('308a2531-7733-489b-8a70-8bf49437f735',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.579821] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d75ed43-93c4-43df-b0ef-cdea8d9dcf68 with status ACTIVE [ 598.580036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.580190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.580190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.580352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.580433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.580598] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.580696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.580752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.580894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.580967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.581151] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.581241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.581297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.581426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.581494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.581577] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d75ed43-93c4-43df-b0ef-cdea8d9dcf68 is going to be updated. [ 598.605754] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.605754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.605870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.606211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.606211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.606429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d75ed43-93c4-43df-b0ef-cdea8d9dcf68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.692724] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.737299] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20: rpc.has_security_group_logging(os_id): False [ 598.765339] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.765515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.765612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.765846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.765953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.766250] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.766364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.766431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.766635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.766718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.766914] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.767324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.767443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.767622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.767718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.767926] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.768044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.768115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.768261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.768352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.768441] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 is going to be created. [ 598.784981] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 223d3f15-b4c4-4d69-81b7-f40d2da399d2 [ 598.785356] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.785427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.785427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.785638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.785726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.785816] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:223d3f15-b4c4-4d69-81b7-f40d2da399d2 already deleted. [ 598.785898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-223d3f15-b4c4-4d69-81b7-f40d2da399d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.845018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.845248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.845321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.845508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.845688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.847193] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8640d5e9-b68a-425b-a6e6-aa1b2b67c66a [ 598.847401] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.847531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.847970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.847970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.847970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.847970] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8640d5e9-b68a-425b-a6e6-aa1b2b67c66a already deleted. [ 598.848368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8640d5e9-b68a-425b-a6e6-aa1b2b67c66a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.858194] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 in Status: IN_PROGRESS for 2s [ 599.085099] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('308a2531-7733-489b-8a70-8bf49437f735',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.199453] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.199685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.200138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.200138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.200138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.200303] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 599.232532] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.232763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.232763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.233870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.233870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.245949] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 599.353478] env[65992]: INFO networking_nsxv3.common.synchronization [req-7d6dec2b-c572-448c-b59e-be3679faf13a req-fc6a6933-55a1-4050-ba03-a11d0b96d2cd service nova] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_rules [ 599.353655] env[65992]: INFO networking_nsxv3.common.synchronization [req-7d6dec2b-c572-448c-b59e-be3679faf13a req-fc6a6933-55a1-4050-ba03-a11d0b96d2cd service nova] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 599.353806] env[65992]: INFO networking_nsxv3.common.synchronization [req-7d6dec2b-c572-448c-b59e-be3679faf13a req-fc6a6933-55a1-4050-ba03-a11d0b96d2cd service nova] Enqueued Resource ID: fef5d78d-1962-407f-8fca-1f607ff5d66f with Priority: HIGHEST for action port [ 599.354421] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_rules [ 599.354565] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 599.354661] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef5d78d-1962-407f-8fca-1f607ff5d66f with Priority: HIGHEST for action port [ 599.354954] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.360625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.360625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.360762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.360762] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.363710] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.363710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.363710] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-fef5d78d-1962-407f-8fca-1f607ff5d66f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.363710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fef5d78d-1962-407f-8fca-1f607ff5d66f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.363710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fef5d78d-1962-407f-8fca-1f607ff5d66f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.364043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fef5d78d-1962-407f-8fca-1f607ff5d66f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.364043] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef5d78d-1962-407f-8fca-1f607ff5d66f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.589353] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.589509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.589580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.589809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.589898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.590112] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 308a2531-7733-489b-8a70-8bf49437f735 is going to be created. [ 599.617159] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.617159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.617159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.617159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.617159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.628657] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 308a2531-7733-489b-8a70-8bf49437f735 in Status: UNINITIALIZED for 2s [ 599.870020] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fef5d78d-1962-407f-8fca-1f607ff5d66f with status ACTIVE [ 599.870020] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.870020] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.870020] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.870020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.870020] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fef5d78d-1962-407f-8fca-1f607ff5d66f is going to be updated. [ 599.871106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.871106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.898124] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.898124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.898124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.898124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.898124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.898124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fef5d78d-1962-407f-8fca-1f607ff5d66f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.875160] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 in Status: SUCCESS [ 600.875467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.257239] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 601.257576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.258015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.258015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.258310] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.259078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.259078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.259078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.259078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.259078] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.640793] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 308a2531-7733-489b-8a70-8bf49437f735 in Status: SUCCESS [ 601.641061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.641239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.641465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.641667] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.641786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.641881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.641998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.642088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.642168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.642259] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('308a2531-7733-489b-8a70-8bf49437f735',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.760983] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.145585] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-308a2531-7733-489b-8a70-8bf49437f735 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.146956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.147087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.147329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.147545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.147692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.147754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.148066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.148131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.148167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.148315] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-308a2531-7733-489b-8a70-8bf49437f735 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.149203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.149203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.149203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.149203] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.149203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.149203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.149203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.149203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.149203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.149203] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('308a2531-7733-489b-8a70-8bf49437f735',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.264559] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.651502] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 308a2531-7733-489b-8a70-8bf49437f735: rpc.has_security_group_logging(os_id): False [ 602.681882] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.681882] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.681882] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.681882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.682570] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.682570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.682570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.682570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.682570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.682570] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 308a2531-7733-489b-8a70-8bf49437f735 is going to be created. [ 602.761024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.761375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.761375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.761610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.761879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.771070] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.771444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.771509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.771743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.771896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.771976] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 602.776652] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 308a2531-7733-489b-8a70-8bf49437f735 in Status: IN_PROGRESS for 2s [ 602.811636] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.811636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.811636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.811636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.811636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.824916] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 603.234823] env[65992]: INFO networking_nsxv3.common.synchronization [req-38742fc2-47de-4b5f-9603-da4af98ef37f req-7accbd33-ad83-46a8-931b-eb3478f36d2e tempest-VolumesAssistedSnapshotsTest-699681554 tempest-VolumesAssistedSnapshotsTest-699681554-project-member] Enqueued Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_members [ 603.234823] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_members [ 603.235454] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5ce6400-2109-4c84-b2da-30e330c81a70 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.236087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.236182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.236483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.236615] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.236715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.236772] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.236933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.237025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.237156] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.638965] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-495 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.638965] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-495" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.639254] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-495" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.639401] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-495" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.639684] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.639848] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.639960] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.640815] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.641032] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.641286] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.641417] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.641620] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.641681] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.641881] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.642125] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.642189] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.666181] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.666417] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.666482] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.666679] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-495" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.667026] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-50f781ff-6ef0-4883-abc5-fa372825b841 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.667187] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-50f781ff-6ef0-4883-abc5-fa372825b841" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.667287] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-50f781ff-6ef0-4883-abc5-fa372825b841" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.667608] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-50f781ff-6ef0-4883-abc5-fa372825b841" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.668084] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f781ff-6ef0-4883-abc5-fa372825b841',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.740179] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.742055] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.742055] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5ce6400-2109-4c84-b2da-30e330c81a70 already deleted. [ 603.742055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.170539] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.170880] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.171064] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.171363] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.171544] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.171730] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 50f781ff-6ef0-4883-abc5-fa372825b841 not found, creating... [ 604.172038] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.172274] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.172426] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.172642] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.172772] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.173062] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.173211] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.173319] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.173519] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.173642] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.173777] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 50f781ff-6ef0-4883-abc5-fa372825b841 is going to be created. [ 604.196951] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.197213] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.197336] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.197604] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.197867] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.198102] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-50f781ff-6ef0-4883-abc5-fa372825b841" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.292057] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f0878912-d6d4-47e0-affb-c9bdd5589304 tempest-ServersWithSpecificFlavorTestJSON-1648883113 tempest-ServersWithSpecificFlavorTestJSON-1648883113-project-member] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_rules [ 604.292509] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_rules [ 604.292801] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.293125] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.293125] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.293409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.293511] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.789050] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 308a2531-7733-489b-8a70-8bf49437f735 in Status: SUCCESS [ 604.789116] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.816475] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.816703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.816703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.817100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.817100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.817238] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 already deleted. [ 604.817238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.839412] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 604.839648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.839822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.840058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.840250] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.840369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.840433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.840589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.840662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.840746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.840844] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.930576] env[65992]: INFO networking_nsxv3.common.synchronization [req-38742fc2-47de-4b5f-9603-da4af98ef37f req-e5626deb-6483-4795-b170-358263091e89 service nova] Enqueued Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_rules [ 604.930576] env[65992]: INFO networking_nsxv3.common.synchronization [req-38742fc2-47de-4b5f-9603-da4af98ef37f req-e5626deb-6483-4795-b170-358263091e89 service nova] Enqueued Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_members [ 604.930576] env[65992]: INFO networking_nsxv3.common.synchronization [req-38742fc2-47de-4b5f-9603-da4af98ef37f req-e5626deb-6483-4795-b170-358263091e89 service nova] Enqueued Resource ID: 50f781ff-6ef0-4883-abc5-fa372825b841 with Priority: HIGHEST for action port [ 604.931951] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_rules [ 604.931951] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_members [ 604.931951] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f781ff-6ef0-4883-abc5-fa372825b841 with Priority: HIGHEST for action port [ 604.931951] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5ce6400-2109-4c84-b2da-30e330c81a70 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.931951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.931951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.931951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.932775] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.933367] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5ce6400-2109-4c84-b2da-30e330c81a70 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.933437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.933487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.933829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.934017] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.934126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.934126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.934241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.934319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.934406] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.935852] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f781ff-6ef0-4883-abc5-fa372825b841 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.936112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f781ff-6ef0-4883-abc5-fa372825b841" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.936112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f781ff-6ef0-4883-abc5-fa372825b841" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.936314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f781ff-6ef0-4883-abc5-fa372825b841" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.936314] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f781ff-6ef0-4883-abc5-fa372825b841',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.151336] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d5599243-d231-4cf3-bfd1-7bd7eda1f03d tempest-ServersWithSpecificFlavorTestJSON-1648883113 tempest-ServersWithSpecificFlavorTestJSON-1648883113-project-member] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_rules [ 605.154402] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_rules [ 605.154402] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.154402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.154402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.154402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.154402] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.343409] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.343791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.343791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.343899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.344090] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.344265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.344265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.344434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.344561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.344635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.344852] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.344932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.344932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.345085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.345218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.345313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.345364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.345840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.345840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.345840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.345840] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.436194] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.438144] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50f781ff-6ef0-4883-abc5-fa372825b841 with status ACTIVE [ 605.438144] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.438144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.438144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.438372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.438372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.438439] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.438763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.438763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.438763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.438882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.438984] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.439101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.439169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.439310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.439395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.439457] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50f781ff-6ef0-4883-abc5-fa372825b841 is going to be updated. [ 605.440667] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5ce6400-2109-4c84-b2da-30e330c81a70 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.440756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.462666] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.462881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.462881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.463105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.463257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.463455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f781ff-6ef0-4883-abc5-fa372825b841" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.675842] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.676493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.676593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.676852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.676920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.677026] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 already deleted. [ 605.677111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.848109] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f9dacc-af29-4b40-93c8-17d4f636d125: rpc.has_security_group_logging(os_id): False [ 605.868229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.868446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.868446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.868646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.868739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.868920] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.869025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.869083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.869232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.869306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.869495] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.869591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.869645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.869786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.869860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.870062] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.870157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.870195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.870325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.870396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.870479] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 605.938849] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.986320] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.986811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.986811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.986923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.986969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.018179] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 606.231539] env[65992]: INFO networking_nsxv3.common.synchronization [req-8d9ca093-157d-4584-bf87-00f5301c6671 req-e14732dc-8ee5-4ca7-8116-ca010a0be925 tempest-DeleteServersAdminTestJSON-1589504368 tempest-DeleteServersAdminTestJSON-1589504368-project-admin] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 606.232108] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 606.232410] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.232543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.232615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.232826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.234105] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.234248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.234316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.234562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.234682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.234802] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.443283] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.443283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.443283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.443871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.443871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.443871] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5ce6400-2109-4c84-b2da-30e330c81a70 is going to be created. [ 606.476959] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.477497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.477497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.477497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.477615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.496538] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5ce6400-2109-4c84-b2da-30e330c81a70 in Status: UNINITIALIZED for 2s [ 606.590260] env[65992]: INFO networking_nsxv3.common.synchronization [req-3c50bdd4-6be9-4fbc-93c7-37c417317325 req-a4b81f62-9abb-4569-a387-b53d5feebe36 tempest-ServerDiagnosticsTest-587959288 tempest-ServerDiagnosticsTest-587959288-project-member] Enqueued Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGHEST for action security_group_members [ 606.590837] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGHEST for action security_group_members [ 606.591171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.591303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.591370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.591545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.591693] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.591791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.591975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.592057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.592120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.592167] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.673526] env[65992]: INFO networking_nsxv3.common.synchronization [req-aea09688-df6d-43fe-8b69-26bc1361eaf9 req-a21394db-730c-4c6a-9cf1-09aeb63042c3 tempest-ServerDiagnosticsNegativeTest-968582946 tempest-ServerDiagnosticsNegativeTest-968582946-project-member] Enqueued Resource ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 with Priority: HIGHEST for action security_group_members [ 606.674044] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 with Priority: HIGHEST for action security_group_members [ 606.674350] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.674478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.675174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.675256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.675434] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.675589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.675658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.675823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.675938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.676069] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06f48e26-5b6b-4a62-b58e-5e3abec6c0c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.739418] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.739676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.739676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.739910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.739999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.740213] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.740331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.740382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.740723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.740723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.740723] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f is going to be updated. [ 606.772675] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.772675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.772675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.772675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.772675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.781812] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: IN_PROGRESS for 2s [ 606.955722] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca1fd505-a81a-490d-b496-f4f6f25231fd req-4ab3054e-09f0-40dd-b9b8-11074c07b588 tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 606.955722] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 606.955722] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.955722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.955722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.955722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.955722] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.955722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.955722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.956070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.956070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.956128] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.096667] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.096866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.096939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.097279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.097279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.097507] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.097599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.097657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.097815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.097877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.097950] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b is going to be updated. [ 607.129953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.130553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.130553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.130553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.130553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.139951] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b in Status: IN_PROGRESS for 2s [ 607.178558] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.178833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.178833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.179786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.179786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.179786] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.179786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.179786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.179786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.180150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.180150] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 is going to be updated. [ 607.211527] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.212082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.212082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.212082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.212509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.225741] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 in Status: IN_PROGRESS for 2s [ 607.460252] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.460585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.460585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.460711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.460801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.460997] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.461110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.461166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.461320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.461394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.461476] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 already deleted. [ 607.461555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.493661] env[65992]: INFO networking_nsxv3.common.synchronization [None req-2950efeb-a217-4d28-8864-5015ddbf8396 None None] Enqueued Resource ID: c2098042-438f-4145-b88d-501ab98e2978 with Priority: HIGHEST for action port [ 607.495968] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2098042-438f-4145-b88d-501ab98e2978 with Priority: HIGHEST for action port [ 607.495968] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2098042-438f-4145-b88d-501ab98e2978 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.496291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2098042-438f-4145-b88d-501ab98e2978" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.496291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2098042-438f-4145-b88d-501ab98e2978" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.496410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2098042-438f-4145-b88d-501ab98e2978" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.497323] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2098042-438f-4145-b88d-501ab98e2978',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.901023] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d393e420-d305-4def-89d0-6a9b7df46abb None None] Enqueued Resource ID: 7ce8f633-b340-445b-bb58-bf9f9ffd7d56 with Priority: HIGHEST for action port [ 607.901245] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ce8f633-b340-445b-bb58-bf9f9ffd7d56 with Priority: HIGHEST for action port [ 607.901521] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ce8f633-b340-445b-bb58-bf9f9ffd7d56 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.901721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ce8f633-b340-445b-bb58-bf9f9ffd7d56" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.901721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ce8f633-b340-445b-bb58-bf9f9ffd7d56" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.901987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ce8f633-b340-445b-bb58-bf9f9ffd7d56" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.902100] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ce8f633-b340-445b-bb58-bf9f9ffd7d56',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.998674] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2098042-438f-4145-b88d-501ab98e2978 [ 607.998846] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.998914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.999057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.999273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.999343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.999409] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2098042-438f-4145-b88d-501ab98e2978 already deleted. [ 607.999518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2098042-438f-4145-b88d-501ab98e2978" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.034124] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 608.035050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.264669] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.264669] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.264669] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.264937] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.265288] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.265476] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.265598] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.266145] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.266145] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.266426] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.266426] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.266426] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.266550] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.266601] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.267099] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.267099] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.309028] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.309028] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.309028] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.309028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.309028] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-f044e609-ea6e-4ee7-9d7d-996f26d712a4 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.309028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-f044e609-ea6e-4ee7-9d7d-996f26d712a4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.309028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-f044e609-ea6e-4ee7-9d7d-996f26d712a4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.309028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-f044e609-ea6e-4ee7-9d7d-996f26d712a4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.309028] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f044e609-ea6e-4ee7-9d7d-996f26d712a4',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.404964] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ce8f633-b340-445b-bb58-bf9f9ffd7d56 [ 608.407913] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.407913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.407913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.407913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.407913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.407913] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ce8f633-b340-445b-bb58-bf9f9ffd7d56 already deleted. [ 608.407913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ce8f633-b340-445b-bb58-bf9f9ffd7d56" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.510548] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5ce6400-2109-4c84-b2da-30e330c81a70 in Status: SUCCESS [ 608.510800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.510927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.512241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.512241] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.512241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.512241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.512241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.512241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.512241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.512241] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.795546] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: SUCCESS [ 608.795546] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f deletion is rescheduled due to dependency. [ 608.795546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.812172] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.812428] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.812619] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.812813] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.812954] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.813173] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port f044e609-ea6e-4ee7-9d7d-996f26d712a4 not found, creating... [ 608.813544] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.813740] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.813870] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.814116] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.814249] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.814590] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.814758] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.814866] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.815079] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.815204] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.815370] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: f044e609-ea6e-4ee7-9d7d-996f26d712a4 is going to be created. [ 608.837996] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.838312] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.839066] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.839066] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.839282] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.839618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-f044e609-ea6e-4ee7-9d7d-996f26d712a4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.015853] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.155628] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b in Status: SUCCESS [ 609.155628] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b deletion is rescheduled due to dependency. [ 609.155628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.237556] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 in Status: IN_PROGRESS for 4s [ 609.520527] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5ce6400-2109-4c84-b2da-30e330c81a70: rpc.has_security_group_logging(os_id): False [ 609.525089] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca1fd505-a81a-490d-b496-f4f6f25231fd req-0e010844-2875-4a90-9176-dd10446bb659 service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 609.525089] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca1fd505-a81a-490d-b496-f4f6f25231fd req-0e010844-2875-4a90-9176-dd10446bb659 service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 609.525089] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca1fd505-a81a-490d-b496-f4f6f25231fd req-0e010844-2875-4a90-9176-dd10446bb659 service nova] Enqueued Resource ID: f044e609-ea6e-4ee7-9d7d-996f26d712a4 with Priority: HIGHEST for action port [ 609.525757] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 609.525947] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 609.525998] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f044e609-ea6e-4ee7-9d7d-996f26d712a4 with Priority: HIGHEST for action port [ 609.526612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.526815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.526881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.529870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.529870] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.529870] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.529870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.529870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.529870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.529870] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.529870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.529870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.529870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.529870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.529870] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.531097] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f044e609-ea6e-4ee7-9d7d-996f26d712a4 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.531196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f044e609-ea6e-4ee7-9d7d-996f26d712a4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.531271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f044e609-ea6e-4ee7-9d7d-996f26d712a4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.531648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f044e609-ea6e-4ee7-9d7d-996f26d712a4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.531717] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f044e609-ea6e-4ee7-9d7d-996f26d712a4',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.541087] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.541237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.541309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.541551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.541595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.541830] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.541929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.541992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.543847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.543847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.543847] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5ce6400-2109-4c84-b2da-30e330c81a70 is going to be created. [ 609.607745] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.608025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.608124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.608436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.608660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.624173] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5ce6400-2109-4c84-b2da-30e330c81a70 in Status: IN_PROGRESS for 2s [ 609.786334] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d3b36f29-8358-4e7c-b86f-95bee38cdc0f None None] Enqueued Resource ID: 15638b3d-a790-463b-841a-cd7ae7c80343 with Priority: HIGHEST for action port [ 609.786601] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15638b3d-a790-463b-841a-cd7ae7c80343 with Priority: HIGHEST for action port [ 609.786935] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-15638b3d-a790-463b-841a-cd7ae7c80343 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.787670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15638b3d-a790-463b-841a-cd7ae7c80343" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.787766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15638b3d-a790-463b-841a-cd7ae7c80343" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.788669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15638b3d-a790-463b-841a-cd7ae7c80343" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.789044] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15638b3d-a790-463b-841a-cd7ae7c80343',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.822719] env[65992]: INFO networking_nsxv3.common.synchronization [req-794107a4-b237-4a75-9e33-d6f35b3405f6 req-3661b756-39dd-486d-b614-a5a0d8b5cb83 tempest-VolumesAdminNegativeTest-999840602 tempest-VolumesAdminNegativeTest-999840602-project-member] Enqueued Resource ID: 4fca3990-1a47-43bc-b0dc-d0194335893d with Priority: HIGHEST for action security_group_members [ 609.822719] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fca3990-1a47-43bc-b0dc-d0194335893d with Priority: HIGHEST for action security_group_members [ 609.823501] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fca3990-1a47-43bc-b0dc-d0194335893d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.823501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.823641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.823783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.824031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.824121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.824121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.824308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.824411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.824512] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fca3990-1a47-43bc-b0dc-d0194335893d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.857344] env[65992]: INFO networking_nsxv3.common.synchronization [None req-1b89b866-19a9-4e6d-8e1b-0207e05ee76c None None] Enqueued Resource ID: bb475fb8-6fcf-4728-93c1-4f1f438a86d6 with Priority: HIGHEST for action port [ 609.857968] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb475fb8-6fcf-4728-93c1-4f1f438a86d6 with Priority: HIGHEST for action port [ 609.858297] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb475fb8-6fcf-4728-93c1-4f1f438a86d6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.858416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb475fb8-6fcf-4728-93c1-4f1f438a86d6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.858530] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb475fb8-6fcf-4728-93c1-4f1f438a86d6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.859270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb475fb8-6fcf-4728-93c1-4f1f438a86d6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.859442] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb475fb8-6fcf-4728-93c1-4f1f438a86d6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.032722] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.036398] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.036531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.036733] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f044e609-ea6e-4ee7-9d7d-996f26d712a4 with status ACTIVE [ 610.036902] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.037235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.037235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.037332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.037371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.037652] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.037652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.037763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.038349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.038431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.038796] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.038796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.038796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.038964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.038964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.039047] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f044e609-ea6e-4ee7-9d7d-996f26d712a4 is going to be updated. [ 610.062248] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.062450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.062518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.062688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.062817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.062969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f044e609-ea6e-4ee7-9d7d-996f26d712a4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.245839] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.246300] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-770" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.246300] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-770" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.246742] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-770" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.247306] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.247306] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.247470] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.247555] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.247713] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.247952] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.248279] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.248279] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.248389] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.248510] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.248654] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.248790] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.279501] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.279501] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.279501] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.279707] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-770" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.280577] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-76eb312d-82b8-4648-84b5-c328093ee585 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.280577] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-76eb312d-82b8-4648-84b5-c328093ee585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.280577] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-76eb312d-82b8-4648-84b5-c328093ee585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.280577] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-76eb312d-82b8-4648-84b5-c328093ee585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.280947] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76eb312d-82b8-4648-84b5-c328093ee585',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.292771] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15638b3d-a790-463b-841a-cd7ae7c80343 [ 610.292825] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.293386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.293386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.293386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.293386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.293386] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15638b3d-a790-463b-841a-cd7ae7c80343 already deleted. [ 610.293599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15638b3d-a790-463b-841a-cd7ae7c80343" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.327783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.327783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.327783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.327783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.327783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.328144] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.328144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.328144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.329046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.329046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.329046] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fca3990-1a47-43bc-b0dc-d0194335893d already deleted. [ 610.329046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.362077] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb475fb8-6fcf-4728-93c1-4f1f438a86d6 [ 610.362539] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.362821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.363553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.363553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.363553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.363553] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb475fb8-6fcf-4728-93c1-4f1f438a86d6 already deleted. [ 610.363553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb475fb8-6fcf-4728-93c1-4f1f438a86d6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.537558] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.782666] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.782888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.783017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.783284] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.783417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.783574] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 76eb312d-82b8-4648-84b5-c328093ee585 not found, creating... [ 610.783807] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.783955] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.784079] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.784286] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.784453] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.784693] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.784837] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.785037] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.785543] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.785543] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.785640] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 76eb312d-82b8-4648-84b5-c328093ee585 is going to be created. [ 610.810640] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.810992] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.811181] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.811460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.811731] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.811996] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-76eb312d-82b8-4648-84b5-c328093ee585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.040981] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.041210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.041277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.041590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.041590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.041737] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be created. [ 611.077198] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.077372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.077445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.077916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.078157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.091043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: UNINITIALIZED for 2s [ 611.258733] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 in Status: SUCCESS [ 611.258983] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06f48e26-5b6b-4a62-b58e-5e3abec6c0c9 deletion is rescheduled due to dependency. [ 611.259155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06f48e26-5b6b-4a62-b58e-5e3abec6c0c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.561327] env[65992]: INFO networking_nsxv3.common.synchronization [req-794107a4-b237-4a75-9e33-d6f35b3405f6 req-039f4409-c6b5-4924-b19c-3c76790f5526 service nova] Enqueued Resource ID: 4fca3990-1a47-43bc-b0dc-d0194335893d with Priority: HIGHEST for action security_group_rules [ 611.561629] env[65992]: INFO networking_nsxv3.common.synchronization [req-794107a4-b237-4a75-9e33-d6f35b3405f6 req-039f4409-c6b5-4924-b19c-3c76790f5526 service nova] Enqueued Resource ID: 4fca3990-1a47-43bc-b0dc-d0194335893d with Priority: HIGHEST for action security_group_members [ 611.561629] env[65992]: INFO networking_nsxv3.common.synchronization [req-794107a4-b237-4a75-9e33-d6f35b3405f6 req-039f4409-c6b5-4924-b19c-3c76790f5526 service nova] Enqueued Resource ID: 76eb312d-82b8-4648-84b5-c328093ee585 with Priority: HIGHEST for action port [ 611.562439] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fca3990-1a47-43bc-b0dc-d0194335893d with Priority: HIGHEST for action security_group_rules [ 611.562439] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fca3990-1a47-43bc-b0dc-d0194335893d with Priority: HIGHEST for action security_group_members [ 611.562439] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76eb312d-82b8-4648-84b5-c328093ee585 with Priority: HIGHEST for action port [ 611.562670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fca3990-1a47-43bc-b0dc-d0194335893d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.562670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.562670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.563109] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.563109] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fca3990-1a47-43bc-b0dc-d0194335893d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.564443] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fca3990-1a47-43bc-b0dc-d0194335893d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.564573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.564656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.564890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.565053] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.565148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.565206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.565781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.565781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.565781] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fca3990-1a47-43bc-b0dc-d0194335893d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.566910] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-76eb312d-82b8-4648-84b5-c328093ee585 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.566910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76eb312d-82b8-4648-84b5-c328093ee585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.567465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76eb312d-82b8-4648-84b5-c328093ee585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.567465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76eb312d-82b8-4648-84b5-c328093ee585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.567465] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76eb312d-82b8-4648-84b5-c328093ee585',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.637538] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5ce6400-2109-4c84-b2da-30e330c81a70 in Status: SUCCESS [ 611.638384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.065676] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fca3990-1a47-43bc-b0dc-d0194335893d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.065878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.068320] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fca3990-1a47-43bc-b0dc-d0194335893d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.072670] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76eb312d-82b8-4648-84b5-c328093ee585 with status ACTIVE [ 612.072670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.072670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.072670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.072670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.072670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.072670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.072967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.072967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.072967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.073066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.073271] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.073353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.074844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.074844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.074844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.074844] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76eb312d-82b8-4648-84b5-c328093ee585 is going to be updated. [ 612.101234] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.101421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.101494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.101731] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.101856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.102055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76eb312d-82b8-4648-84b5-c328093ee585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.576504] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fca3990-1a47-43bc-b0dc-d0194335893d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.733551] env[65992]: INFO networking_nsxv3.common.synchronization [None req-57922751-3362-46a7-af06-ea1d5bc5e023 None None] Enqueued Resource ID: ad5f88ef-0554-4121-84ce-6d9da07affaf with Priority: HIGHEST for action port [ 612.734080] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5f88ef-0554-4121-84ce-6d9da07affaf with Priority: HIGHEST for action port [ 612.735241] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad5f88ef-0554-4121-84ce-6d9da07affaf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.735374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad5f88ef-0554-4121-84ce-6d9da07affaf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.735442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad5f88ef-0554-4121-84ce-6d9da07affaf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.735703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad5f88ef-0554-4121-84ce-6d9da07affaf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.735787] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad5f88ef-0554-4121-84ce-6d9da07affaf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.083269] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.083434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.083560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.083719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.083794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.083896] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fca3990-1a47-43bc-b0dc-d0194335893d is going to be created. [ 613.102741] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 613.104498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.104675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.104910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.105733] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.105733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.105733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.105991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.106171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.109360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.109360] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.111225] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.111225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.111225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.111474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.111474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.122052] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fca3990-1a47-43bc-b0dc-d0194335893d in Status: UNINITIALIZED for 2s [ 613.238766] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad5f88ef-0554-4121-84ce-6d9da07affaf [ 613.239068] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.239171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.239230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.239432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.239523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.239689] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad5f88ef-0554-4121-84ce-6d9da07affaf already deleted. [ 613.239746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad5f88ef-0554-4121-84ce-6d9da07affaf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.611033] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.611434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.611434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.611521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.611648] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.611743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.611807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.611954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.612038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.612121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.612814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.612814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.612814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.612814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.612814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.612814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.612814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.613171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.613171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.613171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.613261] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.693307] env[65992]: INFO networking_nsxv3.common.synchronization [None req-5594aa15-396b-4a05-97b2-9884b311dc28 None None] Enqueued Resource ID: 2f22f944-0d5a-4b1a-af5d-adf52200e01b with Priority: HIGHEST for action port [ 613.693873] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f22f944-0d5a-4b1a-af5d-adf52200e01b with Priority: HIGHEST for action port [ 613.694233] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f22f944-0d5a-4b1a-af5d-adf52200e01b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.698026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f22f944-0d5a-4b1a-af5d-adf52200e01b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.698026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f22f944-0d5a-4b1a-af5d-adf52200e01b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.698026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f22f944-0d5a-4b1a-af5d-adf52200e01b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.698026] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f22f944-0d5a-4b1a-af5d-adf52200e01b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.116273] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6866765e-0cdc-4d35-aa21-1b0f99339ef0: rpc.has_security_group_logging(os_id): False [ 614.143303] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.143303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.143575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.143619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.144680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.144680] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.144680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.144680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.144680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.147160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.147160] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.147160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.147160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.150453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.150453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.150453] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.150453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.150453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.150453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.150453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.150453] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be created. [ 614.204233] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f22f944-0d5a-4b1a-af5d-adf52200e01b [ 614.204563] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.205513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.206388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.206388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.206388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.206388] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f22f944-0d5a-4b1a-af5d-adf52200e01b already deleted. [ 614.206388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f22f944-0d5a-4b1a-af5d-adf52200e01b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.221666] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.221911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.222026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.222330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.222715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.238919] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 615.133936] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fca3990-1a47-43bc-b0dc-d0194335893d in Status: SUCCESS [ 615.134207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.135114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.135114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.135114] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.135114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.135114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.135114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.135378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.135378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.135378] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fca3990-1a47-43bc-b0dc-d0194335893d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.639925] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fca3990-1a47-43bc-b0dc-d0194335893d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.640115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.640192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.640402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.640560] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.640657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.640718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.640993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.640993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.640993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.641240] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fca3990-1a47-43bc-b0dc-d0194335893d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.641240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.641360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.641409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.641574] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.641670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.641670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.641804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.641872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.641953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.642043] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fca3990-1a47-43bc-b0dc-d0194335893d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.923111] env[65992]: INFO networking_nsxv3.common.synchronization [None req-78b947a9-ca98-4a67-af2d-77df8b72f897 None None] Enqueued Resource ID: ac6d419b-b2d5-421e-96df-7c30c0f9e03d with Priority: HIGHEST for action port [ 615.923111] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6d419b-b2d5-421e-96df-7c30c0f9e03d with Priority: HIGHEST for action port [ 615.924966] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac6d419b-b2d5-421e-96df-7c30c0f9e03d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.925260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac6d419b-b2d5-421e-96df-7c30c0f9e03d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.925440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac6d419b-b2d5-421e-96df-7c30c0f9e03d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.925809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac6d419b-b2d5-421e-96df-7c30c0f9e03d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.926513] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac6d419b-b2d5-421e-96df-7c30c0f9e03d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.147045] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fca3990-1a47-43bc-b0dc-d0194335893d: rpc.has_security_group_logging(os_id): False [ 616.170244] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.170407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.170477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.170688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.170774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.170983] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.171263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.171263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.171378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.171378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.171552] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.171643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.171712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.171838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.171917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.172102] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.172194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.172253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.172647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.172647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.172647] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fca3990-1a47-43bc-b0dc-d0194335893d is going to be created. [ 616.219288] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d8516a5a-5974-464c-98ae-8310f6bca3ee None None] Enqueued Resource ID: b472a670-b288-402a-92e4-fbd2a8c9c497 with Priority: HIGHEST for action port [ 616.219387] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b472a670-b288-402a-92e4-fbd2a8c9c497 with Priority: HIGHEST for action port [ 616.219989] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-b472a670-b288-402a-92e4-fbd2a8c9c497 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.220158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b472a670-b288-402a-92e4-fbd2a8c9c497" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.220234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b472a670-b288-402a-92e4-fbd2a8c9c497" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.220437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b472a670-b288-402a-92e4-fbd2a8c9c497" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.220523] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b472a670-b288-402a-92e4-fbd2a8c9c497',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.234023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.234023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.234023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.234023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.234375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.253448] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fca3990-1a47-43bc-b0dc-d0194335893d in Status: IN_PROGRESS for 2s [ 616.255188] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 616.255381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.429544] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac6d419b-b2d5-421e-96df-7c30c0f9e03d [ 616.430758] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.430954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.431037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.431340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.431506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.431591] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac6d419b-b2d5-421e-96df-7c30c0f9e03d already deleted. [ 616.431677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac6d419b-b2d5-421e-96df-7c30c0f9e03d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.726496] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b472a670-b288-402a-92e4-fbd2a8c9c497 [ 616.726758] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.726902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.726968] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.727444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.727444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.727444] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b472a670-b288-402a-92e4-fbd2a8c9c497 already deleted. [ 616.727444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b472a670-b288-402a-92e4-fbd2a8c9c497" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.165331] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e032cc15-c751-4ae1-9864-a4fe57555467 tempest-ServersV294TestFqdnHostnames-2052689092 tempest-ServersV294TestFqdnHostnames-2052689092-project-member] Enqueued Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_rules [ 617.165872] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_rules [ 617.166365] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-436e4ee0-1cae-4512-b766-d84853476f90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.166534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.166607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.166832] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.166914] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.606334] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f8e905a4-8010-400f-906a-65af265ad870 tempest-ServersV294TestFqdnHostnames-2052689092 tempest-ServersV294TestFqdnHostnames-2052689092-project-member] Enqueued Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_rules [ 617.608674] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_rules [ 617.609344] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-436e4ee0-1cae-4512-b766-d84853476f90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.609344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.688305] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.688467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.688539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.688761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.688850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.688943] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 436e4ee0-1cae-4512-b766-d84853476f90 already deleted. [ 617.689114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.689333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.689502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.689584] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.210918] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.210918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.210918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.211364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.211364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.211364] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 436e4ee0-1cae-4512-b766-d84853476f90 already deleted. [ 618.211453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.267062] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fca3990-1a47-43bc-b0dc-d0194335893d in Status: SUCCESS [ 618.267151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.134764] env[65992]: INFO networking_nsxv3.common.synchronization [req-7407b890-0e27-41aa-abe4-0d3f58f0cfdb req-8410575a-ee72-4a80-9e93-b15f402178ef tempest-ServersAdminNegativeTestJSON-1396292550 tempest-ServersAdminNegativeTestJSON-1396292550-project-member] Enqueued Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 620.136949] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 620.138364] env[65992]: INFO networking_nsxv3.common.synchronization [None req-05b01640-5b00-4a7c-8ecf-748288f158dd None None] Enqueued Resource ID: ee0695e1-1064-45c5-8b79-d0862cbb567c with Priority: HIGHEST for action port [ 620.138798] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.138957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.139051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.139502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.139654] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.139734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.139734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.139940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.140049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.140150] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.141442] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee0695e1-1064-45c5-8b79-d0862cbb567c with Priority: HIGHEST for action port [ 620.142223] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee0695e1-1064-45c5-8b79-d0862cbb567c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.142407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee0695e1-1064-45c5-8b79-d0862cbb567c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.142504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee0695e1-1064-45c5-8b79-d0862cbb567c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.142656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee0695e1-1064-45c5-8b79-d0862cbb567c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.143407] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee0695e1-1064-45c5-8b79-d0862cbb567c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.359754] env[65992]: INFO networking_nsxv3.common.synchronization [None req-20bb9f3e-d125-424f-bae2-d869a2c3df1c None None] Enqueued Resource ID: cd49396c-ab6c-444b-bb33-d1e87d846f69 with Priority: HIGHEST for action port [ 620.363111] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd49396c-ab6c-444b-bb33-d1e87d846f69 with Priority: HIGHEST for action port [ 620.366916] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd49396c-ab6c-444b-bb33-d1e87d846f69 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.366916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd49396c-ab6c-444b-bb33-d1e87d846f69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.366916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd49396c-ab6c-444b-bb33-d1e87d846f69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.366916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd49396c-ab6c-444b-bb33-d1e87d846f69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.366916] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd49396c-ab6c-444b-bb33-d1e87d846f69',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.645023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.645023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.645023] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b already deleted. [ 620.645023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.645023] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee0695e1-1064-45c5-8b79-d0862cbb567c [ 620.645628] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.645628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.645628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.645628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.645628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.645628] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee0695e1-1064-45c5-8b79-d0862cbb567c already deleted. [ 620.645843] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee0695e1-1064-45c5-8b79-d0862cbb567c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.868480] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd49396c-ab6c-444b-bb33-d1e87d846f69 [ 620.871658] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.872024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.872024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.872266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.872393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.872512] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd49396c-ab6c-444b-bb33-d1e87d846f69 already deleted. [ 620.872619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd49396c-ab6c-444b-bb33-d1e87d846f69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.310511] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.310963] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.310963] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.312014] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.312396] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.312650] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.312992] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.313130] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.313328] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.313573] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.313730] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.313875] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.314036] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.314286] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.314286] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.314492] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.344587] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.345601] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.345601] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.345968] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.346223] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-300ccafc-95e0-471a-b2d0-5e24f4c946ea taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.346463] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-300ccafc-95e0-471a-b2d0-5e24f4c946ea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.346640] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-300ccafc-95e0-471a-b2d0-5e24f4c946ea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.347110] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-300ccafc-95e0-471a-b2d0-5e24f4c946ea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.348725] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('300ccafc-95e0-471a-b2d0-5e24f4c946ea',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.857426] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.857660] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.857782] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.858094] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.858267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.858430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 300ccafc-95e0-471a-b2d0-5e24f4c946ea not found, creating... [ 621.858692] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.858852] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.859519] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.859519] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.859519] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.859705] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.859705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.859873] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.861129] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.861436] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.861729] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 300ccafc-95e0-471a-b2d0-5e24f4c946ea is going to be created. [ 621.887412] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.887412] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.887412] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.887719] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.888155] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.888581] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-300ccafc-95e0-471a-b2d0-5e24f4c946ea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.237957] env[65992]: INFO networking_nsxv3.common.synchronization [req-2ed96ae0-1db0-405b-9a76-f0938b2039cf req-8c781997-b314-4695-b939-771b0d6d7666 tempest-ServersWithSpecificFlavorTestJSON-1648883113 tempest-ServersWithSpecificFlavorTestJSON-1648883113-project-member] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 622.237957] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 622.237957] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.237957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.238817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.239261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.239545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.241662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.241662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.241662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.241662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.241662] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.502704] env[65992]: INFO networking_nsxv3.common.synchronization [None req-b8a1f1c8-a4b6-4fb9-865f-921e4979de80 None None] Enqueued Resource ID: 8a1f61df-055b-4752-9f53-2135cf274ece with Priority: HIGHEST for action port [ 622.503338] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1f61df-055b-4752-9f53-2135cf274ece with Priority: HIGHEST for action port [ 622.504393] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a1f61df-055b-4752-9f53-2135cf274ece taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.504393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a1f61df-055b-4752-9f53-2135cf274ece" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.504393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a1f61df-055b-4752-9f53-2135cf274ece" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.504573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a1f61df-055b-4752-9f53-2135cf274ece" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.504623] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a1f61df-055b-4752-9f53-2135cf274ece',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.627141] env[65992]: INFO networking_nsxv3.common.synchronization [req-7407b890-0e27-41aa-abe4-0d3f58f0cfdb req-7f6112cd-94b9-4b5f-953e-fd4ea643ae96 service nova] Enqueued Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_rules [ 622.627315] env[65992]: INFO networking_nsxv3.common.synchronization [req-7407b890-0e27-41aa-abe4-0d3f58f0cfdb req-7f6112cd-94b9-4b5f-953e-fd4ea643ae96 service nova] Enqueued Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 622.627443] env[65992]: INFO networking_nsxv3.common.synchronization [req-7407b890-0e27-41aa-abe4-0d3f58f0cfdb req-7f6112cd-94b9-4b5f-953e-fd4ea643ae96 service nova] Enqueued Resource ID: 300ccafc-95e0-471a-b2d0-5e24f4c946ea with Priority: HIGHEST for action port [ 622.627983] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_rules [ 622.628153] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 622.628312] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 300ccafc-95e0-471a-b2d0-5e24f4c946ea with Priority: HIGHEST for action port [ 622.628620] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.628764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.628870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.629484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.629564] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.630431] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.630554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.630621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.633976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.633976] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.633976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.633976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.634216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.634249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.635027] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.635195] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-300ccafc-95e0-471a-b2d0-5e24f4c946ea taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.635307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-300ccafc-95e0-471a-b2d0-5e24f4c946ea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.635379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-300ccafc-95e0-471a-b2d0-5e24f4c946ea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.635510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-300ccafc-95e0-471a-b2d0-5e24f4c946ea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.635579] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('300ccafc-95e0-471a-b2d0-5e24f4c946ea',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.744267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.744442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.744514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.744734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.744827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.745354] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.745354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.745354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.745354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.745550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.745550] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 already deleted. [ 622.745687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.792661] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.792661] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-35" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.792877] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-35" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.793249] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-35" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.793667] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.793667] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.793667] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.794141] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.794281] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.794483] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.794619] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.794731] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.794790] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.794899] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.794997] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.795163] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.826268] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.826268] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.826268] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.826268] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-35" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.826268] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-eb277944-c9f8-40be-8f6c-10386db3155e taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.826268] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-eb277944-c9f8-40be-8f6c-10386db3155e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.826268] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-eb277944-c9f8-40be-8f6c-10386db3155e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.826268] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-eb277944-c9f8-40be-8f6c-10386db3155e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.826268] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb277944-c9f8-40be-8f6c-10386db3155e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.009748] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a1f61df-055b-4752-9f53-2135cf274ece [ 623.009748] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.009748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.009748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.009748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.009748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.009748] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a1f61df-055b-4752-9f53-2135cf274ece already deleted. [ 623.009748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a1f61df-055b-4752-9f53-2135cf274ece" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.120559] env[65992]: INFO networking_nsxv3.common.synchronization [None req-800101ef-6d4d-4fa9-bfe1-7d15a18d7377 None None] Enqueued Resource ID: 3cb9ebb9-605f-4b73-9531-3af72e3f267c with Priority: HIGHEST for action port [ 623.121203] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb9ebb9-605f-4b73-9531-3af72e3f267c with Priority: HIGHEST for action port [ 623.121494] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb9ebb9-605f-4b73-9531-3af72e3f267c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.121779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb9ebb9-605f-4b73-9531-3af72e3f267c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.121893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb9ebb9-605f-4b73-9531-3af72e3f267c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.122171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb9ebb9-605f-4b73-9531-3af72e3f267c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.122171] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb9ebb9-605f-4b73-9531-3af72e3f267c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.141957] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.141957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.141957] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.141957] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 300ccafc-95e0-471a-b2d0-5e24f4c946ea with status ACTIVE [ 623.141957] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.141957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.141957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.141957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.141957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.141957] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.141957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.147029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.147029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.147029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.147029] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.147029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.147029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.147029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.147029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.147029] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 300ccafc-95e0-471a-b2d0-5e24f4c946ea is going to be updated. [ 623.176902] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.176902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.176902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.176902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.176902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.176902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-300ccafc-95e0-471a-b2d0-5e24f4c946ea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.333705] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.334014] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.334194] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.334532] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.334726] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.334919] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port eb277944-c9f8-40be-8f6c-10386db3155e not found, creating... [ 623.335276] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.335510] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.335690] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.335946] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.336604] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.337991] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.337991] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.337991] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.337991] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.337991] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.337991] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: eb277944-c9f8-40be-8f6c-10386db3155e is going to be created. [ 623.366129] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.366364] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.366503] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.366750] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.367127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.367397] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-eb277944-c9f8-40be-8f6c-10386db3155e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.624861] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cb9ebb9-605f-4b73-9531-3af72e3f267c [ 623.625210] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.625278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.625318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.625502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.625605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.625675] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cb9ebb9-605f-4b73-9531-3af72e3f267c already deleted. [ 623.625762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb9ebb9-605f-4b73-9531-3af72e3f267c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.650878] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.108473] env[65992]: INFO networking_nsxv3.common.synchronization [req-2ed96ae0-1db0-405b-9a76-f0938b2039cf req-9ae6092c-e252-4a38-a46a-a1334b970261 service nova] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_rules [ 624.108647] env[65992]: INFO networking_nsxv3.common.synchronization [req-2ed96ae0-1db0-405b-9a76-f0938b2039cf req-9ae6092c-e252-4a38-a46a-a1334b970261 service nova] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 624.108779] env[65992]: INFO networking_nsxv3.common.synchronization [req-2ed96ae0-1db0-405b-9a76-f0938b2039cf req-9ae6092c-e252-4a38-a46a-a1334b970261 service nova] Enqueued Resource ID: eb277944-c9f8-40be-8f6c-10386db3155e with Priority: HIGHEST for action port [ 624.109327] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_rules [ 624.109468] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 624.109795] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb277944-c9f8-40be-8f6c-10386db3155e with Priority: HIGHEST for action port [ 624.110106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.110229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.110292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.110486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.110563] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.111603] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.111603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.111603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.111814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.111906] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.112012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.112072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.112209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.112286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.112373] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.113106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb277944-c9f8-40be-8f6c-10386db3155e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.113207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb277944-c9f8-40be-8f6c-10386db3155e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.113265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb277944-c9f8-40be-8f6c-10386db3155e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.113413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb277944-c9f8-40be-8f6c-10386db3155e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.113482] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb277944-c9f8-40be-8f6c-10386db3155e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.153286] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.153491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.153491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.153707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.153792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.153887] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b is going to be created. [ 624.179975] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.180223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.180223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.180406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.180556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.191448] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: UNINITIALIZED for 2s [ 624.337568] env[65992]: INFO networking_nsxv3.common.synchronization [req-e7df9ad6-95fb-4315-9858-01f12fb97cbf req-6a76bf7f-6cb4-4f9d-9dd2-1daeb0c5aa22 tempest-ServerExternalEventsTest-214952409 tempest-ServerExternalEventsTest-214952409-project-member] Enqueued Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGHEST for action security_group_members [ 624.338520] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGHEST for action security_group_members [ 624.339228] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.339361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.339423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.339660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.339956] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.340091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.340152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.340314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.340396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.340930] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.477165] env[65992]: INFO networking_nsxv3.common.synchronization [req-93a27dbd-40ac-45d3-acba-d90b9f80e9a4 req-4e81ae7e-f19a-4b82-9dc8-43786055bcda tempest-AttachInterfacesV270Test-20339854 tempest-AttachInterfacesV270Test-20339854-project-member] Enqueued Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGHEST for action security_group_members [ 624.478433] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGHEST for action security_group_members [ 624.478820] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-67682f49-bbb6-48c3-b395-881a8117b7ac taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.478959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.479142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.479456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.479632] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.479744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.479802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.479970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.480065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.480243] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.615289] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.615518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.619302] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.620196] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb277944-c9f8-40be-8f6c-10386db3155e with status ACTIVE [ 624.620682] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.620682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.620682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.620858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.620858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.621017] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.621083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.621126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.621266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.621342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.621528] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.621621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.621674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.621811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.621893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.621980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb277944-c9f8-40be-8f6c-10386db3155e is going to be updated. [ 624.652392] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.652829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.652829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.652829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.652933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.653118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb277944-c9f8-40be-8f6c-10386db3155e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.842792] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.842973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.842973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.843196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.843291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.843507] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.843657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.843721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.843884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.843960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.844058] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 is going to be updated. [ 624.874417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.874563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.874611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.874914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.874986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.885308] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 in Status: IN_PROGRESS for 2s [ 624.962816] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.963014] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-675" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.963215] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-675" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.963477] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-675" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.963726] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.963880] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.964369] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.964597] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.964765] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.964991] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.966330] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.966330] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.966330] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.966330] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.966330] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.966330] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.982347] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.982570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.982640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.982864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.982959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.983169] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.983267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.983322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.983474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.983549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.983628] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67682f49-bbb6-48c3-b395-881a8117b7ac already deleted. [ 624.983785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.984928] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.985101] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.985235] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.985381] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-675" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.985643] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-4a842a8c-c14f-40c4-9253-beb4395023df taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.985792] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-4a842a8c-c14f-40c4-9253-beb4395023df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.985900] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-4a842a8c-c14f-40c4-9253-beb4395023df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.986183] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-4a842a8c-c14f-40c4-9253-beb4395023df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.986312] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a842a8c-c14f-40c4-9253-beb4395023df',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.125611] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.329866] env[65992]: INFO networking_nsxv3.common.synchronization [req-7e86c01a-c3d1-4b3e-ac54-3f6ea6af84bf req-6a652b3b-ce49-4a75-86d0-8eb9bb55a5e1 tempest-ServerAddressesNegativeTestJSON-765852989 tempest-ServerAddressesNegativeTestJSON-765852989-project-member] Enqueued Resource ID: 308a2531-7733-489b-8a70-8bf49437f735 with Priority: HIGHEST for action security_group_members [ 625.330428] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 308a2531-7733-489b-8a70-8bf49437f735 with Priority: HIGHEST for action security_group_members [ 625.330826] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-308a2531-7733-489b-8a70-8bf49437f735 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.330937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.330937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.331164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.331332] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.331457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.331522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.331672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.331757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.331846] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('308a2531-7733-489b-8a70-8bf49437f735',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.488266] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.488472] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.488594] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.488984] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.489110] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.489326] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 4a842a8c-c14f-40c4-9253-beb4395023df not found, creating... [ 625.489631] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.489797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.489907] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.490171] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.490304] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.490592] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.490739] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.490851] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.491431] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.491431] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.491431] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 4a842a8c-c14f-40c4-9253-beb4395023df is going to be created. [ 625.513571] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.515440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.515440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.515440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.515440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.515440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-4a842a8c-c14f-40c4-9253-beb4395023df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.629489] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.629489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.629489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.629489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.629769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.629769] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be created. [ 625.655649] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.656018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.656018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.656096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.656439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.672174] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: UNINITIALIZED for 2s [ 625.697172] env[65992]: INFO networking_nsxv3.common.synchronization [None req-1f554de7-51a3-4aa6-893f-dea62cbc9bf3 None None] Enqueued Resource ID: 1abb5cc9-7f41-4a99-83c5-02e2c3ede23b with Priority: HIGHEST for action port [ 625.697410] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1abb5cc9-7f41-4a99-83c5-02e2c3ede23b with Priority: HIGHEST for action port [ 625.697782] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-1abb5cc9-7f41-4a99-83c5-02e2c3ede23b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.697948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1abb5cc9-7f41-4a99-83c5-02e2c3ede23b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.697987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1abb5cc9-7f41-4a99-83c5-02e2c3ede23b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.698744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1abb5cc9-7f41-4a99-83c5-02e2c3ede23b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.698744] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1abb5cc9-7f41-4a99-83c5-02e2c3ede23b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.834338] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.834627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.834714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.834937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.835047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.835249] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.835350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.835403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.835555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.835628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.835711] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 308a2531-7733-489b-8a70-8bf49437f735 is going to be updated. [ 625.869135] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.869320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.869390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.869580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.869719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.879492] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 308a2531-7733-489b-8a70-8bf49437f735 in Status: IN_PROGRESS for 2s [ 626.201489] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1abb5cc9-7f41-4a99-83c5-02e2c3ede23b [ 626.202355] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.202677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.202677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.202835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.202923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.203043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1abb5cc9-7f41-4a99-83c5-02e2c3ede23b already deleted. [ 626.203116] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1abb5cc9-7f41-4a99-83c5-02e2c3ede23b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.204102] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: SUCCESS [ 626.204272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.204366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.204551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.204731] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.204836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.204897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.205261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.205363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.205449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.205538] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.289629] env[65992]: INFO networking_nsxv3.common.synchronization [req-93a27dbd-40ac-45d3-acba-d90b9f80e9a4 req-19ab28ca-07e7-4946-ac71-7f0a4e5bb949 service nova] Enqueued Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGHEST for action security_group_rules [ 626.289729] env[65992]: INFO networking_nsxv3.common.synchronization [req-93a27dbd-40ac-45d3-acba-d90b9f80e9a4 req-19ab28ca-07e7-4946-ac71-7f0a4e5bb949 service nova] Enqueued Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGHEST for action security_group_members [ 626.289859] env[65992]: INFO networking_nsxv3.common.synchronization [req-93a27dbd-40ac-45d3-acba-d90b9f80e9a4 req-19ab28ca-07e7-4946-ac71-7f0a4e5bb949 service nova] Enqueued Resource ID: 4a842a8c-c14f-40c4-9253-beb4395023df with Priority: HIGHEST for action port [ 626.290578] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGHEST for action security_group_rules [ 626.290748] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGHEST for action security_group_members [ 626.291414] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a842a8c-c14f-40c4-9253-beb4395023df with Priority: HIGHEST for action port [ 626.292103] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67682f49-bbb6-48c3-b395-881a8117b7ac taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.293047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.293047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.293047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.293047] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.293969] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-67682f49-bbb6-48c3-b395-881a8117b7ac taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.294115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.294162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.294638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.294638] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.294638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.294819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.294879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.294975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.295952] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.297175] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a842a8c-c14f-40c4-9253-beb4395023df taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.297175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a842a8c-c14f-40c4-9253-beb4395023df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.297175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a842a8c-c14f-40c4-9253-beb4395023df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.297493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a842a8c-c14f-40c4-9253-beb4395023df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.301653] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a842a8c-c14f-40c4-9253-beb4395023df',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.709822] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.710214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.710214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.710340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.710446] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.710552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.710841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.710841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.710841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.710950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.711446] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.711446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.711446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.711446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.711780] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.711780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.711780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.711780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.711949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.711949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.711949] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.802680] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.803758] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-67682f49-bbb6-48c3-b395-881a8117b7ac taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.803897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.805853] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a842a8c-c14f-40c4-9253-beb4395023df with status ACTIVE [ 626.805853] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.806062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.806062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.806601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.806638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.806843] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.806941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.806988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.807220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.807312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.807500] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.807591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.807642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.807787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.808055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.808055] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a842a8c-c14f-40c4-9253-beb4395023df is going to be updated. [ 626.831816] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.831997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.832087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.832301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.832431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.832585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a842a8c-c14f-40c4-9253-beb4395023df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.857231] env[65992]: INFO networking_nsxv3.common.synchronization [req-82980d41-5d68-49db-b802-af286225f758 req-9116bd38-f3d1-474a-a584-e77623e124c5 tempest-DeleteServersAdminTestJSON-1602258422 tempest-DeleteServersAdminTestJSON-1602258422-project-member] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 626.857860] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 626.858650] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.858799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.858848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.859075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.859293] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.859401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.859461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.859621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.859753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.859812] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.900369] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 in Status: SUCCESS [ 626.900559] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 deletion is rescheduled due to dependency. [ 626.900928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.214426] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa8c9176-c0d4-4732-93ba-a80e6182488b: rpc.has_security_group_logging(os_id): False [ 627.235982] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.235982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.235982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.236281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.236281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.237045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.237045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.237045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.237314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.237314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.237663] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.237766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.237918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.238229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.238508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.238765] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.238910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.239059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.239410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.239539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.239685] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b is going to be created. [ 627.286902] env[65992]: INFO networking_nsxv3.common.synchronization [None req-efcd417f-092a-413d-9b7f-851d7e7c3f4e tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 627.288604] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 627.288766] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.288898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.288969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.289299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.289370] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.306143] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.313275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.313439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.313727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.313727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.314166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.327652] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: IN_PROGRESS for 2s [ 627.364855] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.364855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.364855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.364855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.364855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.364855] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.364855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.364855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.364855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.364855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.364855] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f is going to be updated. [ 627.406622] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.406622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.406622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.406622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.407035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.431142] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: IN_PROGRESS for 2s [ 627.438582] env[65992]: INFO networking_nsxv3.common.synchronization [None req-8ebd3990-1a0c-4cb3-a739-dcd8ba7c21fe tempest-ServersTestJSON-1987185259 tempest-ServersTestJSON-1987185259-project-member] Enqueued Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_rules [ 627.444735] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_rules [ 627.444735] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.444735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.444735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.444735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.444735] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.549667] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.549864] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.549989] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.550282] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.550543] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.551464] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.551464] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.551464] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.555366] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.555366] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.555366] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.555366] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.555366] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.555366] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.555366] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.555366] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.557664] env[65992]: INFO networking_nsxv3.common.synchronization [None req-9c9d5b34-61bc-4dec-8c95-747396525cdb tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 627.558586] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 627.558911] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.559111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.579475] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.579616] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.579751] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.579920] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.580246] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-be7ff8df-da8b-4d26-b74c-b67c17690ff7 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.580425] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-be7ff8df-da8b-4d26-b74c-b67c17690ff7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.580539] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-be7ff8df-da8b-4d26-b74c-b67c17690ff7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.580952] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-be7ff8df-da8b-4d26-b74c-b67c17690ff7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.581314] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be7ff8df-da8b-4d26-b74c-b67c17690ff7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.683804] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: SUCCESS [ 627.684050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.684297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.684444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.685675] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.685675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.685675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.685675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.685675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.685675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.685675] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.732501] env[65992]: INFO networking_nsxv3.common.synchronization [None req-56fa57a0-a5e9-430d-957d-01003b7e6db2 tempest-ServersTestJSON-1987185259 tempest-ServersTestJSON-1987185259-project-member] Enqueued Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_rules [ 627.734189] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_rules [ 627.734637] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.734637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.808640] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.808865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.808865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.810182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.810182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.810472] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67682f49-bbb6-48c3-b395-881a8117b7ac is going to be created. [ 627.814103] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.814256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.814310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.814662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.814782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.814871] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 already deleted. [ 627.815049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.815117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.815288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.815401] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.818438] env[65992]: INFO networking_nsxv3.common.synchronization [None req-fa89f4c7-3d21-4996-a826-8737ed9ebe12 None None] Enqueued Resource ID: 82f65a08-5209-4f4b-b413-358875cd1ea6 with Priority: HIGHEST for action port [ 627.818962] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82f65a08-5209-4f4b-b413-358875cd1ea6 with Priority: HIGHEST for action port [ 627.819296] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-82f65a08-5209-4f4b-b413-358875cd1ea6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.819639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82f65a08-5209-4f4b-b413-358875cd1ea6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.819639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82f65a08-5209-4f4b-b413-358875cd1ea6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.820211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82f65a08-5209-4f4b-b413-358875cd1ea6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.820211] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82f65a08-5209-4f4b-b413-358875cd1ea6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.835920] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.836098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.836155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.836350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.836536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.848652] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67682f49-bbb6-48c3-b395-881a8117b7ac in Status: UNINITIALIZED for 2s [ 627.889769] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 308a2531-7733-489b-8a70-8bf49437f735 in Status: SUCCESS [ 627.889940] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 308a2531-7733-489b-8a70-8bf49437f735 deletion is rescheduled due to dependency. [ 627.890097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-308a2531-7733-489b-8a70-8bf49437f735" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.974998] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.975176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.975281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.975480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.975660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.975660] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f already deleted. [ 627.975844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.975905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.976087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.976190] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.084944] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.084944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.084944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.084944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.084944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.084944] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port be7ff8df-da8b-4d26-b74c-b67c17690ff7 not found, creating... [ 628.085314] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.085314] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.085404] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.085760] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.085760] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.086051] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.086451] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.086451] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.087204] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.087204] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.087398] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: be7ff8df-da8b-4d26-b74c-b67c17690ff7 is going to be created. [ 628.111710] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.112473] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.112943] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.113612] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.113944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.114373] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-be7ff8df-da8b-4d26-b74c-b67c17690ff7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.187988] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.322288] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82f65a08-5209-4f4b-b413-358875cd1ea6 [ 628.322288] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.322288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.322288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.322288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.322288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.322288] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82f65a08-5209-4f4b-b413-358875cd1ea6 already deleted. [ 628.322288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82f65a08-5209-4f4b-b413-358875cd1ea6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.345509] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.345509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.345509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.345749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.345838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.345938] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 already deleted. [ 628.346030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.499816] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.500015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.500196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.500410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.500569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.500723] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f already deleted. [ 628.500845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.691196] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b1651ec-9ca7-4bf6-866b-28fade5b94c5: rpc.has_security_group_logging(os_id): False [ 628.711315] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.711436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.711609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.711941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.712026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.712279] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.712381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.712441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.712605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.713927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.714089] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be created. [ 628.773596] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.773981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.773981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.775510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.775510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.794143] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: IN_PROGRESS for 2s [ 628.820069] env[65992]: INFO networking_nsxv3.common.synchronization [req-82980d41-5d68-49db-b802-af286225f758 req-354ebcd7-06de-44fb-b1c4-cca873522a61 service nova] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_rules [ 628.820069] env[65992]: INFO networking_nsxv3.common.synchronization [req-82980d41-5d68-49db-b802-af286225f758 req-354ebcd7-06de-44fb-b1c4-cca873522a61 service nova] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 628.820069] env[65992]: INFO networking_nsxv3.common.synchronization [req-82980d41-5d68-49db-b802-af286225f758 req-354ebcd7-06de-44fb-b1c4-cca873522a61 service nova] Enqueued Resource ID: be7ff8df-da8b-4d26-b74c-b67c17690ff7 with Priority: HIGHEST for action port [ 628.820674] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_rules [ 628.820847] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 628.820954] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be7ff8df-da8b-4d26-b74c-b67c17690ff7 with Priority: HIGHEST for action port [ 628.821346] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.821505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.821675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.821860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.821980] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.824993] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.824993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.824993] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-be7ff8df-da8b-4d26-b74c-b67c17690ff7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.824993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be7ff8df-da8b-4d26-b74c-b67c17690ff7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.824993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be7ff8df-da8b-4d26-b74c-b67c17690ff7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.824993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be7ff8df-da8b-4d26-b74c-b67c17690ff7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.824993] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be7ff8df-da8b-4d26-b74c-b67c17690ff7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.327153] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.327153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.327153] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be7ff8df-da8b-4d26-b74c-b67c17690ff7 with status ACTIVE [ 629.327395] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.327395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.327483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.328119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.328119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.328119] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.329241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.329241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.329241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.329241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.329730] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.329730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.329730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.329730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.329976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.329976] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be7ff8df-da8b-4d26-b74c-b67c17690ff7 is going to be updated. [ 629.348256] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: SUCCESS [ 629.348496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.355031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.355255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.355327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.355488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.355719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.355844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be7ff8df-da8b-4d26-b74c-b67c17690ff7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.451607] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: SUCCESS [ 629.451607] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f deletion is rescheduled due to dependency. [ 629.451607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.451607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.451607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.451607] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.451607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.451607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.451607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.451607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.451607] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.861534] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67682f49-bbb6-48c3-b395-881a8117b7ac in Status: SUCCESS [ 629.861791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.862139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.862308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.862500] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.862646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.862685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.862823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.862903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.862981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.863104] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.954844] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.365677] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-67682f49-bbb6-48c3-b395-881a8117b7ac taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.365865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.365962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.366310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.367132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.367132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.367132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.367132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.367132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.371271] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-67682f49-bbb6-48c3-b395-881a8117b7ac taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.371271] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.371271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.371271] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.459366] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.638600] env[65992]: INFO networking_nsxv3.common.synchronization [None req-05c2c82a-ba7f-49dc-9b6a-f73f12629145 tempest-ServersTestBootFromVolume-1851510878 tempest-ServersTestBootFromVolume-1851510878-project-member] Enqueued Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_rules [ 630.639932] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_rules [ 630.644438] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.644438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.644438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.644438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.644438] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.737440] env[65992]: INFO networking_nsxv3.common.synchronization [None req-1d8611aa-ae89-4cac-bab1-2253e69319d1 tempest-ServersTestBootFromVolume-1851510878 tempest-ServersTestBootFromVolume-1851510878-project-member] Enqueued Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_rules [ 630.737440] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_rules [ 630.738931] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.741791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.814189] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: SUCCESS [ 630.815527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.874948] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67682f49-bbb6-48c3-b395-881a8117b7ac: rpc.has_security_group_logging(os_id): False [ 630.901116] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.901746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.902649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.903098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.903098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.903555] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.903713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.903784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.903993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.904160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.904407] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.904584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.904935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.905145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.905294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.905470] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.905571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.905671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.905789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.905868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.905957] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67682f49-bbb6-48c3-b395-881a8117b7ac is going to be created. [ 630.963868] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.963868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.963868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.963868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.963868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.963868] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f is going to be updated. [ 631.015758] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.017044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.017044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.017044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.017044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.025466] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.025466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.025466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.025764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.026162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.042717] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: IN_PROGRESS for 2s [ 631.044933] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67682f49-bbb6-48c3-b395-881a8117b7ac in Status: IN_PROGRESS for 2s [ 631.173276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.173667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.173944] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.174071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.174224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.174338] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 already deleted. [ 631.174458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.174660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.175107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.175284] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.703260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.703536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.703536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.703804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.703930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.703930] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 already deleted. [ 631.704016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.861371] env[65992]: INFO networking_nsxv3.common.synchronization [req-b59b01c3-46a4-4f1b-b777-266e29173787 req-f78ddc36-3884-4910-ae6c-d5bc7fcc7954 tempest-ServersV294TestFqdnHostnames-2052689092 tempest-ServersV294TestFqdnHostnames-2052689092-project-member] Enqueued Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_members [ 632.862019] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_members [ 632.862446] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-436e4ee0-1cae-4512-b766-d84853476f90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.862586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.862659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.863019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.863267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.863331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.863391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.863565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.863664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.863777] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.054980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: SUCCESS [ 633.055357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.055590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.055891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.056145] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.056223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.056223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.056404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.056494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.056583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.056676] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.059596] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67682f49-bbb6-48c3-b395-881a8117b7ac in Status: SUCCESS [ 633.059596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.366476] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.366476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.366476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.370363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.371561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.371561] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.371561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.371561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.371561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.371561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.371561] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 436e4ee0-1cae-4512-b766-d84853476f90 already deleted. [ 633.371561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.405591] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.405988] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-918" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.405988] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-918" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.406255] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-918" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.407057] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.407057] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.407057] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.407261] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.407261] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.407964] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.407964] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.408143] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.408204] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.408448] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.408448] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.408580] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.429099] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.429327] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.429468] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.429662] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-918" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.429985] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-6518aef0-451e-4484-8cf7-d1f0345db458 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.430178] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-6518aef0-451e-4484-8cf7-d1f0345db458" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.430290] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-6518aef0-451e-4484-8cf7-d1f0345db458" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.430655] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-6518aef0-451e-4484-8cf7-d1f0345db458" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.430802] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6518aef0-451e-4484-8cf7-d1f0345db458',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.562064] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.562064] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.562064] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.562064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.562779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.562779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.562966] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.563148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.563241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.563441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.563567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.563688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.563816] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.779450] env[65992]: INFO networking_nsxv3.common.synchronization [req-03f5c76c-3f0e-4a27-8d79-f76b18a22322 req-d3c2288a-bbae-4e49-87be-5e8f922ae406 tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 633.780349] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 633.780912] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.781259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.781364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.781778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.781778] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.782040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.782040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.782129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.782218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.782346] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.933181] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.933925] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.933925] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.933925] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.934214] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.934214] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 6518aef0-451e-4484-8cf7-d1f0345db458 not found, creating... [ 633.934420] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.934610] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.934737] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.935046] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.935112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.935791] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.936063] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.936305] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.936376] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.936486] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.936629] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 6518aef0-451e-4484-8cf7-d1f0345db458 is going to be created. [ 633.959807] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.960039] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.960155] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.960454] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.961450] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.961450] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-6518aef0-451e-4484-8cf7-d1f0345db458" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.067497] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76f6dffd-94d6-4a01-8082-da146608e51f: rpc.has_security_group_logging(os_id): False [ 634.103876] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.104122] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.104122] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.104412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.104412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.104668] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.104815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.104909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.105066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.105186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.105514] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.105736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.105803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.105994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.106182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.106386] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.106578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.106628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.106770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.107257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.107257] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f is going to be updated. [ 634.188797] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.189083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.189083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.189346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.189542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.203194] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: IN_PROGRESS for 2s [ 634.288398] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.288674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.288674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.288932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.289567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.289567] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.289567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.289567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.289857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.289857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.289857] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 634.320780] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.321450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.321532] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.321765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.321905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.338140] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 634.679594] env[65992]: INFO networking_nsxv3.common.synchronization [req-b59b01c3-46a4-4f1b-b777-266e29173787 req-b47c63b1-785a-4d02-afe7-11473d65589a service nova] Enqueued Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_rules [ 634.679594] env[65992]: INFO networking_nsxv3.common.synchronization [req-b59b01c3-46a4-4f1b-b777-266e29173787 req-b47c63b1-785a-4d02-afe7-11473d65589a service nova] Enqueued Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_members [ 634.679856] env[65992]: INFO networking_nsxv3.common.synchronization [req-b59b01c3-46a4-4f1b-b777-266e29173787 req-b47c63b1-785a-4d02-afe7-11473d65589a service nova] Enqueued Resource ID: 6518aef0-451e-4484-8cf7-d1f0345db458 with Priority: HIGHEST for action port [ 634.680347] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_rules [ 634.680507] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_members [ 634.680608] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6518aef0-451e-4484-8cf7-d1f0345db458 with Priority: HIGHEST for action port [ 634.680883] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-436e4ee0-1cae-4512-b766-d84853476f90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.681046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.684447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.684680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.684816] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.688018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-436e4ee0-1cae-4512-b766-d84853476f90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.688018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.688018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.688018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.688018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.688018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.688018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.688018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.688018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.688018] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.688769] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-6518aef0-451e-4484-8cf7-d1f0345db458 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.688769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6518aef0-451e-4484-8cf7-d1f0345db458" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.688928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6518aef0-451e-4484-8cf7-d1f0345db458" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.689064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6518aef0-451e-4484-8cf7-d1f0345db458" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.689157] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6518aef0-451e-4484-8cf7-d1f0345db458',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.193648] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6518aef0-451e-4484-8cf7-d1f0345db458 with status ACTIVE [ 635.193970] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.194125] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.194248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.194496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.194644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.195070] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.195070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.195070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.195229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.195332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.195495] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.195719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.195719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.195899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.195989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.196108] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6518aef0-451e-4484-8cf7-d1f0345db458 is going to be updated. [ 635.197483] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-436e4ee0-1cae-4512-b766-d84853476f90 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.197621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.197762] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.223336] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.223561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.223617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.223795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.223931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.224108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6518aef0-451e-4484-8cf7-d1f0345db458" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.703160] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.210134] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.210522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.210522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.210645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.210645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.210723] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 436e4ee0-1cae-4512-b766-d84853476f90 is going to be created. [ 636.224431] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: SUCCESS [ 636.224723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.255733] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.256028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.256028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.256540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.256540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.273814] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 436e4ee0-1cae-4512-b766-d84853476f90 in Status: UNINITIALIZED for 2s [ 636.353043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 636.353043] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 636.353043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.684361] env[65992]: INFO networking_nsxv3.common.synchronization [req-8090fe46-1ce2-456e-b261-fae0e482c6f9 req-c5366183-5ac2-4ec5-82c9-78915d344b61 tempest-ServersAdminTestJSON-561694848 tempest-ServersAdminTestJSON-561694848-project-member] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 637.684686] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 637.685713] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.685713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.685713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.685713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.686728] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.686728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.686728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.686728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.686728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.686728] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.949101] env[65992]: INFO networking_nsxv3.common.synchronization [req-817a699f-4665-4616-ba16-95ca928da53c req-7dd48475-5638-4463-bac9-ce02165c242b tempest-VolumesAdminNegativeTest-999840602 tempest-VolumesAdminNegativeTest-999840602-project-member] Enqueued Resource ID: 4fca3990-1a47-43bc-b0dc-d0194335893d with Priority: HIGHEST for action security_group_members [ 637.949756] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fca3990-1a47-43bc-b0dc-d0194335893d with Priority: HIGHEST for action security_group_members [ 637.950488] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fca3990-1a47-43bc-b0dc-d0194335893d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.950650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.950719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.950942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.951125] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.952098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.952184] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.952615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.952726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.952832] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fca3990-1a47-43bc-b0dc-d0194335893d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.189804] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.287919] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 436e4ee0-1cae-4512-b766-d84853476f90 in Status: SUCCESS [ 638.287919] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.287919] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.287919] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.288251] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.288251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.288251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.288407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.288468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.288569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.288692] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.419579] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-652 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.419816] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.419965] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.420290] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.420614] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.420816] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.420953] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.421213] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.421411] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.421781] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.421781] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.422851] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.422985] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.423136] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.423267] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.423408] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.448939] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.449195] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.449370] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.449609] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.449937] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-1805f520-1c21-43b1-8119-4f3be91ab433 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.450231] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-1805f520-1c21-43b1-8119-4f3be91ab433" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.450417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-1805f520-1c21-43b1-8119-4f3be91ab433" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.450769] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-1805f520-1c21-43b1-8119-4f3be91ab433" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.450919] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1805f520-1c21-43b1-8119-4f3be91ab433',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.455227] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.456174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.456275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.456572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.456612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.456847] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.457033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.457139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.457582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.457582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.457582] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fca3990-1a47-43bc-b0dc-d0194335893d is going to be updated. [ 638.500422] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.500422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.500785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.501316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.502051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.516333] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fca3990-1a47-43bc-b0dc-d0194335893d in Status: IN_PROGRESS for 2s [ 638.693102] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.791204] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.956029] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.956029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.956029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.956029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.956029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.956029] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 1805f520-1c21-43b1-8119-4f3be91ab433 not found, creating... [ 638.956029] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.956029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.956029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.957113] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.957450] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.958140] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.958521] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.958792] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.959217] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.960029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.960029] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 1805f520-1c21-43b1-8119-4f3be91ab433 is going to be created. [ 638.984124] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.984460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.984680] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.985218] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.985682] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.985682] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-1805f520-1c21-43b1-8119-4f3be91ab433" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.196137] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.196377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.196471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.196735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.196844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.196979] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 639.234607] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.235029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.235268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.235504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.235722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.248993] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 639.295291] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 436e4ee0-1cae-4512-b766-d84853476f90: rpc.has_security_group_logging(os_id): False [ 639.318454] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.318726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.318726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.318987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.319111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.319436] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.319554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.319635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.319815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.319895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.320021] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 436e4ee0-1cae-4512-b766-d84853476f90 is going to be created. [ 639.400674] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.400844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.400945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.401205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.401389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.418773] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 436e4ee0-1cae-4512-b766-d84853476f90 in Status: IN_PROGRESS for 2s [ 639.740035] env[65992]: INFO networking_nsxv3.common.synchronization [req-8090fe46-1ce2-456e-b261-fae0e482c6f9 req-16413990-9bcb-4e1f-b614-359c3e88b18f service nova] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_rules [ 639.740300] env[65992]: INFO networking_nsxv3.common.synchronization [req-8090fe46-1ce2-456e-b261-fae0e482c6f9 req-16413990-9bcb-4e1f-b614-359c3e88b18f service nova] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 639.740466] env[65992]: INFO networking_nsxv3.common.synchronization [req-8090fe46-1ce2-456e-b261-fae0e482c6f9 req-16413990-9bcb-4e1f-b614-359c3e88b18f service nova] Enqueued Resource ID: 1805f520-1c21-43b1-8119-4f3be91ab433 with Priority: HIGHEST for action port [ 639.740991] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_rules [ 639.741137] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 639.741231] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1805f520-1c21-43b1-8119-4f3be91ab433 with Priority: HIGHEST for action port [ 639.741493] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.741614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.741714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.741864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.741943] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.742776] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.742869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.743066] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-1805f520-1c21-43b1-8119-4f3be91ab433 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.743158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1805f520-1c21-43b1-8119-4f3be91ab433" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.743205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1805f520-1c21-43b1-8119-4f3be91ab433" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.743376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1805f520-1c21-43b1-8119-4f3be91ab433" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.743447] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1805f520-1c21-43b1-8119-4f3be91ab433',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.248819] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.248819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.248819] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1805f520-1c21-43b1-8119-4f3be91ab433 with status ACTIVE [ 640.249082] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.249082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.249201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.249452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.249531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.249633] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.249726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.249787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.249934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.250118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.250316] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.250442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.250491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.251587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.251762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.251799] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1805f520-1c21-43b1-8119-4f3be91ab433 is going to be updated. [ 640.287801] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.288246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.288246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.288438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.288483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.288641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1805f520-1c21-43b1-8119-4f3be91ab433" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.527099] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fca3990-1a47-43bc-b0dc-d0194335893d in Status: SUCCESS [ 640.527309] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fca3990-1a47-43bc-b0dc-d0194335893d deletion is rescheduled due to dependency. [ 640.527429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fca3990-1a47-43bc-b0dc-d0194335893d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.260525] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 641.260989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.261068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.261354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.261594] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.261726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.261799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.262026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.262169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.262977] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.438439] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 436e4ee0-1cae-4512-b766-d84853476f90 in Status: SUCCESS [ 641.439297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.655470] env[65992]: INFO networking_nsxv3.common.synchronization [None req-65c35d55-5575-4a7d-b9b2-c352fcb8d1a0 None None] Enqueued Resource ID: 7cc3aabd-6fd5-4107-837b-f348b1498b67 with Priority: HIGHEST for action port [ 641.655470] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc3aabd-6fd5-4107-837b-f348b1498b67 with Priority: HIGHEST for action port [ 641.655975] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc3aabd-6fd5-4107-837b-f348b1498b67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.656172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc3aabd-6fd5-4107-837b-f348b1498b67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.656269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc3aabd-6fd5-4107-837b-f348b1498b67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.657749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc3aabd-6fd5-4107-837b-f348b1498b67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.657996] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc3aabd-6fd5-4107-837b-f348b1498b67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.764573] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.916540] env[65992]: INFO networking_nsxv3.common.synchronization [None req-ba973260-b803-4306-9821-c6fc811aa0bc None None] Enqueued Resource ID: be021e01-411c-44b8-8b2f-c7af4e489728 with Priority: HIGHEST for action port [ 641.916540] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be021e01-411c-44b8-8b2f-c7af4e489728 with Priority: HIGHEST for action port [ 641.916540] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-be021e01-411c-44b8-8b2f-c7af4e489728 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.916540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be021e01-411c-44b8-8b2f-c7af4e489728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.919205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be021e01-411c-44b8-8b2f-c7af4e489728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.921541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be021e01-411c-44b8-8b2f-c7af4e489728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.921541] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be021e01-411c-44b8-8b2f-c7af4e489728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.160576] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cc3aabd-6fd5-4107-837b-f348b1498b67 [ 642.162708] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.162708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.162708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.162708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.162708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.162708] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cc3aabd-6fd5-4107-837b-f348b1498b67 already deleted. [ 642.162708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc3aabd-6fd5-4107-837b-f348b1498b67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.268958] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.422558] env[65992]: INFO networking_nsxv3.common.synchronization [req-80faf46e-5c37-4c5e-bd6e-a265f69d3859 req-a1b2a867-d1d0-459e-826e-de3c41243d49 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 642.424382] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be021e01-411c-44b8-8b2f-c7af4e489728 [ 642.424382] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.424382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.424382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.424382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.424382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.425308] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be021e01-411c-44b8-8b2f-c7af4e489728 already deleted. [ 642.425449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be021e01-411c-44b8-8b2f-c7af4e489728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.425607] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 642.426321] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.426480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.426559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.427557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.427557] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.427557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.427557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.427557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.427557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.427557] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.775223] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.775223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.775223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.775223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.775508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.775508] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 642.818330] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.818541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.818587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.818826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.818991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.834238] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 642.930723] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.930723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.930723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.930723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.930723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.931276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.931276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.931276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.931276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.931276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.931542] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 already deleted. [ 642.931542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.090378] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-679 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.090378] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-679" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.090378] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-679" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.091978] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-679" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.091978] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.091978] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.091978] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.092381] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.092439] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.092660] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.092828] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.093035] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.093158] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.093270] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.093369] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.093497] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.121358] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.121558] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.121829] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.121829] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-679" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.122197] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.122395] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.122472] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.122835] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.122966] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4114f001-f0b2-4aa7-bb1f-5a51d3a656b3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.630847] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.630847] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.630847] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.630847] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.631452] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.631452] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 not found, creating... [ 643.631661] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.631661] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.631852] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.632564] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.632564] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.632564] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.632847] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.632847] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.633209] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.633209] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.633209] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 is going to be created. [ 643.656563] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.656836] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.656927] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.657247] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.657488] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.657716] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.023794] env[65992]: INFO networking_nsxv3.common.synchronization [req-dd521f9c-4bd7-4041-ac53-af6c9d924d6f req-8f493a5f-7c5f-40b1-93e3-59e4214a4a1d tempest-ListImageFiltersTestJSON-580190969 tempest-ListImageFiltersTestJSON-580190969-project-member] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 644.024716] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 644.025251] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.025429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.025856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.026034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.026241] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.026367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.026459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.026608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.026723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.026838] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.416267] env[65992]: INFO networking_nsxv3.common.synchronization [None req-32b37f19-1aab-439a-8988-4a5dfd36295f None None] Enqueued Resource ID: df2ac875-fb79-4c5a-ac1e-195b2f7875fe with Priority: HIGHEST for action port [ 644.416267] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2ac875-fb79-4c5a-ac1e-195b2f7875fe with Priority: HIGHEST for action port [ 644.416267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-df2ac875-fb79-4c5a-ac1e-195b2f7875fe taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.416824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df2ac875-fb79-4c5a-ac1e-195b2f7875fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.416924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df2ac875-fb79-4c5a-ac1e-195b2f7875fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.417268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df2ac875-fb79-4c5a-ac1e-195b2f7875fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.417387] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df2ac875-fb79-4c5a-ac1e-195b2f7875fe',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.440530] env[65992]: INFO networking_nsxv3.common.synchronization [req-80faf46e-5c37-4c5e-bd6e-a265f69d3859 req-139e5bc5-ddaa-4f26-9ea7-9a4a1df3ecc1 service nova] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 644.440530] env[65992]: INFO networking_nsxv3.common.synchronization [req-80faf46e-5c37-4c5e-bd6e-a265f69d3859 req-139e5bc5-ddaa-4f26-9ea7-9a4a1df3ecc1 service nova] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 644.440530] env[65992]: INFO networking_nsxv3.common.synchronization [req-80faf46e-5c37-4c5e-bd6e-a265f69d3859 req-139e5bc5-ddaa-4f26-9ea7-9a4a1df3ecc1 service nova] Enqueued Resource ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with Priority: HIGHEST for action port [ 644.440530] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 644.440530] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 644.440530] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with Priority: HIGHEST for action port [ 644.441413] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.441413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.441413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.441413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.441413] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.442962] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.442962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.442962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.443270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.443356] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.444027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.444118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.444324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.444371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.444460] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.445498] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.445653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.446015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.446015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.446015] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4114f001-f0b2-4aa7-bb1f-5a51d3a656b3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.532548] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.532548] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.532548] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf already deleted. [ 644.532548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.534784] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.534953] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.535109] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.535756] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.535963] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.536145] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.536233] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.536760] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.536760] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.536760] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.536933] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.536933] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.537059] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.537157] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.537255] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.537377] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.560145] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.560259] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 644.560382] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.560757] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.560884] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.561049] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.561168] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.561524] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.561663] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f3ebe53-e0ec-417b-ab10-e1c8635beea3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.850169] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 644.850169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.850169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.850169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.850169] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.850169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.850169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.850169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.850169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.850169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.850169] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.921538] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df2ac875-fb79-4c5a-ac1e-195b2f7875fe [ 644.921538] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.921695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.921695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.921907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.921995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.922104] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df2ac875-fb79-4c5a-ac1e-195b2f7875fe already deleted. [ 644.922185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df2ac875-fb79-4c5a-ac1e-195b2f7875fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.948245] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with status ACTIVE [ 644.948499] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.948650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.948650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.948862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.949034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.949264] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.949264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.949453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.949490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.949604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.951299] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.951299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.951299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.951299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.951299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.951299] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 is going to be updated. [ 644.951644] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.952470] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.952606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.975919] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.977458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.977458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.977458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.977458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.977458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.065281] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.065281] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.065281] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.065281] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.065700] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.065700] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 5f3ebe53-e0ec-417b-ab10-e1c8635beea3 not found, creating... [ 645.066298] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.066298] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.066298] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.066464] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.066720] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.066933] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.067100] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.067219] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.067418] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.067553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.067667] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 5f3ebe53-e0ec-417b-ab10-e1c8635beea3 is going to be created. [ 645.114709] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.115110] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.115341] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.115787] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.116189] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.116537] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.289932] env[65992]: INFO networking_nsxv3.common.synchronization [None req-34b0d55e-72cb-47b1-a8fb-e09cb2b587e2 None None] Enqueued Resource ID: c3d8d5dd-3943-418c-87fb-1257e7328dad with Priority: HIGHEST for action port [ 645.290521] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3d8d5dd-3943-418c-87fb-1257e7328dad with Priority: HIGHEST for action port [ 645.290837] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3d8d5dd-3943-418c-87fb-1257e7328dad taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.291033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3d8d5dd-3943-418c-87fb-1257e7328dad" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.291033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3d8d5dd-3943-418c-87fb-1257e7328dad" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.291295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3d8d5dd-3943-418c-87fb-1257e7328dad" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.291373] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3d8d5dd-3943-418c-87fb-1257e7328dad',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.352262] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.352262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.352486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.352528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.352679] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.352777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.352846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.352990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.353152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.353205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.353338] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.353432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.353487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.353622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.353751] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.353841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.353898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.354050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.354214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.354214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.354320] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.454016] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.693027] env[65992]: INFO networking_nsxv3.common.synchronization [req-dedf0a5f-0351-47b0-a1ee-5896b27e12f5 req-3e735904-da28-4c5b-8be9-55d1c0b7c56c tempest-ServersTestJSON-1987185259 tempest-ServersTestJSON-1987185259-project-member] Enqueued Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_members [ 645.693725] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_members [ 645.694468] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b14e2cad-daae-4705-9dc6-6e9de8cef89f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.695152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.695236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.695501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.695738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.695808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.695899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.696163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.696221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.696322] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.784816] env[65992]: INFO networking_nsxv3.common.synchronization [req-dd521f9c-4bd7-4041-ac53-af6c9d924d6f req-b3c88d52-5f11-4a0d-bb37-557376fefbfd service nova] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_rules [ 645.785019] env[65992]: INFO networking_nsxv3.common.synchronization [req-dd521f9c-4bd7-4041-ac53-af6c9d924d6f req-b3c88d52-5f11-4a0d-bb37-557376fefbfd service nova] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 645.785225] env[65992]: INFO networking_nsxv3.common.synchronization [req-dd521f9c-4bd7-4041-ac53-af6c9d924d6f req-b3c88d52-5f11-4a0d-bb37-557376fefbfd service nova] Enqueued Resource ID: 5f3ebe53-e0ec-417b-ab10-e1c8635beea3 with Priority: HIGHEST for action port [ 645.785705] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_rules [ 645.785980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 645.785980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f3ebe53-e0ec-417b-ab10-e1c8635beea3 with Priority: HIGHEST for action port [ 645.788327] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.788474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.788542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.788855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.788992] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.789868] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.789987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.790067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.790235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.790447] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.790531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.790531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.790656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.790743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.790828] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.793200] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.793200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.793200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.794050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.794170] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f3ebe53-e0ec-417b-ab10-e1c8635beea3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.796936] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3d8d5dd-3943-418c-87fb-1257e7328dad [ 645.797181] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.797300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.797365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.798426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.798652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.798652] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3d8d5dd-3943-418c-87fb-1257e7328dad already deleted. [ 645.798882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3d8d5dd-3943-418c-87fb-1257e7328dad" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.857877] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f9dacc-af29-4b40-93c8-17d4f636d125: rpc.has_security_group_logging(os_id): False [ 645.878982] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.879560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.879873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.880173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.880631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.881052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.881799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.881928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.882124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.882238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.882579] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.882700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.882775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.882972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.883090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.883321] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.883499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.883534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.883685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.883846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.883895] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 645.944943] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.944943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.944943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.945322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.945322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.957189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.957189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.957189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.957537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.957537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.957622] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be created. [ 645.959744] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 645.999529] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.999764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.999839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.000072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.000238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.032468] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: UNINITIALIZED for 2s [ 646.048172] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.048406] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-385" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.048649] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-385" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.049092] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-385" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.049375] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.049522] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.049678] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.049903] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.050103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.050345] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.050455] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.050554] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.050691] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.050792] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.050890] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.051027] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.077449] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.077665] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.077745] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.077920] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-385" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.078356] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-86b32f79-3a74-4218-a199-0db2f1f263d1 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.078545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-86b32f79-3a74-4218-a199-0db2f1f263d1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.078663] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-86b32f79-3a74-4218-a199-0db2f1f263d1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.078990] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-86b32f79-3a74-4218-a199-0db2f1f263d1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.079593] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86b32f79-3a74-4218-a199-0db2f1f263d1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.198946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.198946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.198946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.202949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.202949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.202949] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.202949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.202949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.202949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.202949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.202949] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f already deleted. [ 646.202949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.297522] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.297693] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.297838] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.303089] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f3ebe53-e0ec-417b-ab10-e1c8635beea3 with status ACTIVE [ 646.303089] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.303089] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.303089] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.303089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.303089] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f3ebe53-e0ec-417b-ab10-e1c8635beea3 is going to be updated. [ 646.328935] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.328935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.328935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.328935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.328935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.328935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f3ebe53-e0ec-417b-ab10-e1c8635beea3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.582641] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.583916] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.583916] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.583916] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.583916] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.583916] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 86b32f79-3a74-4218-a199-0db2f1f263d1 not found, creating... [ 646.583916] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.584219] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.584219] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.586288] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.586288] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.586288] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.586288] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.586288] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.586288] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.586288] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.586288] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 86b32f79-3a74-4218-a199-0db2f1f263d1 is going to be created. [ 646.659239] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.659590] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.659824] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.660199] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.662262] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.662521] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-86b32f79-3a74-4218-a199-0db2f1f263d1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.800269] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.309357] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.309787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.309787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.309868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.310053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.310238] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be created. [ 647.348753] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.349019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.349019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.349217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.349409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.360490] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: UNINITIALIZED for 2s [ 647.370348] env[65992]: INFO networking_nsxv3.common.synchronization [req-dedf0a5f-0351-47b0-a1ee-5896b27e12f5 req-405b1a79-56d9-4575-a588-944d2b067a0c service nova] Enqueued Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_rules [ 647.370580] env[65992]: INFO networking_nsxv3.common.synchronization [req-dedf0a5f-0351-47b0-a1ee-5896b27e12f5 req-405b1a79-56d9-4575-a588-944d2b067a0c service nova] Enqueued Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_members [ 647.370837] env[65992]: INFO networking_nsxv3.common.synchronization [req-dedf0a5f-0351-47b0-a1ee-5896b27e12f5 req-405b1a79-56d9-4575-a588-944d2b067a0c service nova] Enqueued Resource ID: 86b32f79-3a74-4218-a199-0db2f1f263d1 with Priority: HIGHEST for action port [ 647.371057] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_rules [ 647.371170] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_members [ 647.371247] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86b32f79-3a74-4218-a199-0db2f1f263d1 with Priority: HIGHEST for action port [ 647.372379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.372577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.372644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.372886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.372995] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.374234] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b14e2cad-daae-4705-9dc6-6e9de8cef89f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.374234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.374234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.374446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.374503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.374943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.374943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.374943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.375184] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.375251] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.376089] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-86b32f79-3a74-4218-a199-0db2f1f263d1 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.376234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86b32f79-3a74-4218-a199-0db2f1f263d1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.376298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86b32f79-3a74-4218-a199-0db2f1f263d1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.376407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86b32f79-3a74-4218-a199-0db2f1f263d1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.376472] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86b32f79-3a74-4218-a199-0db2f1f263d1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.878615] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b14e2cad-daae-4705-9dc6-6e9de8cef89f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.878615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.881344] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.882782] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86b32f79-3a74-4218-a199-0db2f1f263d1 with status ACTIVE [ 647.885435] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.885435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.885435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.885435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.885435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.885435] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.885435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.885435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.888022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.888022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.888022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.888022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.888022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.888022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.888022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.888921] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86b32f79-3a74-4218-a199-0db2f1f263d1 is going to be updated. [ 647.912881] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.913077] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.913127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.916259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.916259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.916259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86b32f79-3a74-4218-a199-0db2f1f263d1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.973196] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 647.973446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.054718] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 648.054943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.055168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.055396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.055585] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.055707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.055771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.055924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.056015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.056110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.056198] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.390047] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.562440] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.892322] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.892541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.892624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.892877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.892965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.893174] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f is going to be created. [ 648.931992] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.932164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.932230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.932496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.932587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.947621] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f in Status: UNINITIALIZED for 2s [ 649.066269] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7: rpc.has_security_group_logging(os_id): False [ 649.095036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.095036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.095036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.095036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.095036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.095036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.095036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.095036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.095036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.095036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.095617] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be created. [ 649.177617] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.177617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.177617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.177617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.177617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.191289] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: IN_PROGRESS for 2s [ 649.372218] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: SUCCESS [ 649.372457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.372633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.372858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.373081] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.373215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.373279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.373439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.373553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.373616] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.373686] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.876628] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.876976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.876976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.877133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.877316] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.877538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.877615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.878921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.878921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.878921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.879658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.879658] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.382225] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdc7601c-fb13-4bed-8af5-454bff4da6cf: rpc.has_security_group_logging(os_id): False [ 650.402425] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.403969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.404588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.404886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.405018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.405324] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.406515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.406647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.406918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.407063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.407385] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.407917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.407917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.408299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.408442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.408704] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.408843] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.408927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.409165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.409229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.409309] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be created. [ 650.474889] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.474889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.474889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.475193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.475193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.492889] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: IN_PROGRESS for 2s [ 650.962619] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f in Status: SUCCESS [ 650.962619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.962619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.962619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.962619] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.962619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.962619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.962619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.962619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.962619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.962619] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.182867] env[65992]: INFO networking_nsxv3.common.synchronization [req-3ff1fe90-257f-43fc-8b24-627b8c657be7 req-cdb12a3a-3306-434f-ba54-3590e016b31c tempest-ListImageFiltersTestJSON-580190969 tempest-ListImageFiltersTestJSON-580190969-project-member] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 651.182867] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 651.182867] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.182867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.182867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.183127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.183447] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.183565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.183629] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.183785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.183871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.183962] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.211313] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 651.211756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.342589] env[65992]: INFO networking_nsxv3.common.synchronization [req-181d457d-f68f-45a5-8381-7dc7bb89324e req-73b6fc57-2514-4326-b5ab-b257f68b1dfb tempest-SecurityGroupRulesNegativeTestJSON-1984127239 tempest-SecurityGroupRulesNegativeTestJSON-1984127239-project-member] Enqueued Resource ID: b4804450-5491-42a2-8495-7f2864a7d814 with Priority: HIGHEST for action security_group_rules [ 651.344166] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4804450-5491-42a2-8495-7f2864a7d814 with Priority: HIGHEST for action security_group_rules [ 651.344166] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4804450-5491-42a2-8495-7f2864a7d814 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.344166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4804450-5491-42a2-8495-7f2864a7d814" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.344166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4804450-5491-42a2-8495-7f2864a7d814" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.344166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4804450-5491-42a2-8495-7f2864a7d814" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.344166] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4804450-5491-42a2-8495-7f2864a7d814',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.465433] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.515734] env[65992]: INFO networking_nsxv3.common.synchronization [None req-277e11d4-e4cb-432d-ae4b-3c054abee399 None None] Enqueued Resource ID: f9e64a62-d8ce-475f-b336-43333670b4d0 with Priority: HIGHEST for action port [ 651.517786] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e64a62-d8ce-475f-b336-43333670b4d0 with Priority: HIGHEST for action port [ 651.518872] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9e64a62-d8ce-475f-b336-43333670b4d0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.519248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9e64a62-d8ce-475f-b336-43333670b4d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.519407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9e64a62-d8ce-475f-b336-43333670b4d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.519730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9e64a62-d8ce-475f-b336-43333670b4d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.519818] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9e64a62-d8ce-475f-b336-43333670b4d0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.689836] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.867788] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.867924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.867967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.868972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.868972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.868972] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4804450-5491-42a2-8495-7f2864a7d814 already deleted. [ 651.868972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4804450-5491-42a2-8495-7f2864a7d814" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.970600] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b14e2cad-daae-4705-9dc6-6e9de8cef89f: rpc.has_security_group_logging(os_id): False [ 651.993479] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.993753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.993753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.993898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.994032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.994289] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.994408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.994456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.994743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.994829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.994905] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f is going to be created. [ 652.022196] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9e64a62-d8ce-475f-b336-43333670b4d0 [ 652.022552] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.022552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.022872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.022872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.025835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.025835] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9e64a62-d8ce-475f-b336-43333670b4d0 already deleted. [ 652.025835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9e64a62-d8ce-475f-b336-43333670b4d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.045665] env[65992]: INFO networking_nsxv3.common.synchronization [None req-35dd0435-569e-4f36-893e-ee1f58073941 None None] Enqueued Resource ID: 0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb with Priority: HIGHEST for action port [ 652.046404] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb with Priority: HIGHEST for action port [ 652.046951] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.047229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.047355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.047660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.047792] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.072384] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.072384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.073416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.073561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.073802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.100753] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f in Status: IN_PROGRESS for 2s [ 652.191904] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.396055] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.396372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.396519] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.396789] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.397161] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.397290] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.397401] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.397610] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.397743] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.397937] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.398147] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.398268] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.398362] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.398462] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.398555] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.398683] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.421425] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.421607] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.421714] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.421905] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.422366] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.422577] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.422663] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.422996] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.423320] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.506977] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: SUCCESS [ 652.506977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.552656] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb [ 652.553379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.553586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.553675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.553908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.554126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.554256] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb already deleted. [ 652.554352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d1af3d0-a2cd-40ee-ae4b-8c49dc754ffb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.700715] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.700715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.700715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.700715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.701230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.701380] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be updated. [ 652.733873] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.734900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.734900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.734900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.734900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.744530] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: IN_PROGRESS for 2s [ 652.816172] env[65992]: INFO networking_nsxv3.common.synchronization [req-28deae65-ac68-43f4-a3d2-a50c5f9ac912 req-57cd97a0-7705-4a7a-add5-b0be47b282eb tempest-AttachInterfacesV270Test-20339854 tempest-AttachInterfacesV270Test-20339854-project-member] Enqueued Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGHEST for action security_group_members [ 652.816172] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGHEST for action security_group_members [ 652.816373] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-67682f49-bbb6-48c3-b395-881a8117b7ac taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.816489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.816536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.816764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.817102] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.817559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.817559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.817559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.817559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.817737] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.932170] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.932170] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.932170] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.932170] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.932170] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.932170] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1 not found, creating... [ 652.932170] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.934406] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.934859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.935301] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.935659] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.936343] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.936684] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.936978] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.937411] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.937665] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.937917] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1 is going to be created. [ 652.964226] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.965679] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.965679] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.965679] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.967525] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.967525] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.322345] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.323393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.323393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.323393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.323393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.323393] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.323682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.323682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.323760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.323864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.323923] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67682f49-bbb6-48c3-b395-881a8117b7ac is going to be updated. [ 653.372596] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.374019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.374402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.374858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.375451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.386958] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67682f49-bbb6-48c3-b395-881a8117b7ac in Status: IN_PROGRESS for 2s [ 653.751635] env[65992]: INFO networking_nsxv3.common.synchronization [req-3ff1fe90-257f-43fc-8b24-627b8c657be7 req-049a0e9c-14fd-4621-96ed-f88b8b27b863 service nova] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_rules [ 653.751951] env[65992]: INFO networking_nsxv3.common.synchronization [req-3ff1fe90-257f-43fc-8b24-627b8c657be7 req-049a0e9c-14fd-4621-96ed-f88b8b27b863 service nova] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 653.751951] env[65992]: INFO networking_nsxv3.common.synchronization [req-3ff1fe90-257f-43fc-8b24-627b8c657be7 req-049a0e9c-14fd-4621-96ed-f88b8b27b863 service nova] Enqueued Resource ID: c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1 with Priority: HIGHEST for action port [ 653.752535] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_rules [ 653.752678] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 653.752774] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1 with Priority: HIGHEST for action port [ 653.753158] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.753517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.753517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.753699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.753785] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.754858] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.755191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.755191] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.755313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.755354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.758021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.758021] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.115886] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f in Status: SUCCESS [ 654.116124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.257696] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.258636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.258636] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1 with status ACTIVE [ 654.258809] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.258933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.259012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.259247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.259332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.259541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.259888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.259888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.259888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.260053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.260109] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.260214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.260574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.260574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.260574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.260574] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1 is going to be updated. [ 654.290324] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.290552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.290681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.290908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.291097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.291347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5ff96d9-6f3a-4c5c-8de4-2aa5e6596af1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.730884] env[65992]: INFO networking_nsxv3.common.synchronization [None req-cb066f28-9122-4d30-ae26-50d2aae22fe4 None None] Enqueued Resource ID: 23259291-977b-4287-85c7-05a3d0742ae3 with Priority: HIGHEST for action port [ 654.731513] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23259291-977b-4287-85c7-05a3d0742ae3 with Priority: HIGHEST for action port [ 654.731826] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-23259291-977b-4287-85c7-05a3d0742ae3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.731984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23259291-977b-4287-85c7-05a3d0742ae3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.732791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23259291-977b-4287-85c7-05a3d0742ae3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.733037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23259291-977b-4287-85c7-05a3d0742ae3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.733137] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23259291-977b-4287-85c7-05a3d0742ae3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.755208] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: SUCCESS [ 654.756014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.757797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.757797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.757797] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.757797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.757797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.757797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.757797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.757797] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.995323] env[65992]: INFO networking_nsxv3.common.synchronization [None req-faa7913b-bd36-4ea1-a88b-0235c6351abc None None] Enqueued Resource ID: 95dc7bb9-4386-41ee-997a-0917057b8066 with Priority: HIGHEST for action port [ 654.995323] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95dc7bb9-4386-41ee-997a-0917057b8066 with Priority: HIGHEST for action port [ 654.995323] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-95dc7bb9-4386-41ee-997a-0917057b8066 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.995323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95dc7bb9-4386-41ee-997a-0917057b8066" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.995323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95dc7bb9-4386-41ee-997a-0917057b8066" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.995323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95dc7bb9-4386-41ee-997a-0917057b8066" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.995323] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95dc7bb9-4386-41ee-997a-0917057b8066',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.236025] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23259291-977b-4287-85c7-05a3d0742ae3 [ 655.236508] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.236626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.236700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.237331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.237331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.237331] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23259291-977b-4287-85c7-05a3d0742ae3 already deleted. [ 655.237331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23259291-977b-4287-85c7-05a3d0742ae3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.260682] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.403066] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67682f49-bbb6-48c3-b395-881a8117b7ac in Status: SUCCESS [ 655.405021] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67682f49-bbb6-48c3-b395-881a8117b7ac deletion is rescheduled due to dependency. [ 655.405021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.499549] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95dc7bb9-4386-41ee-997a-0917057b8066 [ 655.499549] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.499549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.499549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.499549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.499549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.499549] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95dc7bb9-4386-41ee-997a-0917057b8066 already deleted. [ 655.499549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95dc7bb9-4386-41ee-997a-0917057b8066" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.551280] env[65992]: INFO networking_nsxv3.common.synchronization [req-a74c03c7-806a-46ca-8f52-bd8056c9b030 req-104769ac-f4f7-49c0-900d-2ec944e58a1d tempest-MigrationsAdminTest-1940019867 tempest-MigrationsAdminTest-1940019867-project-member] Enqueued Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 655.552942] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 655.552942] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.552942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.552942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.552942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.554613] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.554613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.554613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.554613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.554613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.554613] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.763696] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.060921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.060921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.060921] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c already deleted. [ 656.060921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.089440] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.089440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.091139] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.091139] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.091139] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.091139] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.091483] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.091483] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.092605] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.092605] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.092605] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.092605] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.092605] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.092847] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.092895] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.093054] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.118086] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.118300] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.118432] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.118599] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.118956] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-784d2c25-9879-46f9-b227-ca88d2f3aab0 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.119149] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-784d2c25-9879-46f9-b227-ca88d2f3aab0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.119268] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-784d2c25-9879-46f9-b227-ca88d2f3aab0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.119700] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-784d2c25-9879-46f9-b227-ca88d2f3aab0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.120543] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('784d2c25-9879-46f9-b227-ca88d2f3aab0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.266208] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.266295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.266335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.266552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.266642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.266738] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be updated. [ 656.309193] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.309388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.309388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.309623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.309780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.329082] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: IN_PROGRESS for 2s [ 656.623191] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.623459] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.623582] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.623905] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.624121] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.624300] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 784d2c25-9879-46f9-b227-ca88d2f3aab0 not found, creating... [ 656.624586] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.624744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.624857] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.625109] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.625254] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.625677] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.625677] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.625822] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.625986] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.626171] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.626333] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 784d2c25-9879-46f9-b227-ca88d2f3aab0 is going to be created. [ 656.648914] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.648914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.648914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.650534] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.651392] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.651847] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-784d2c25-9879-46f9-b227-ca88d2f3aab0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.395707] env[65992]: INFO networking_nsxv3.common.synchronization [req-a74c03c7-806a-46ca-8f52-bd8056c9b030 req-cac3b1af-37c0-45ef-bdec-01ff42b73bdb service nova] Enqueued Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_rules [ 657.395707] env[65992]: INFO networking_nsxv3.common.synchronization [req-a74c03c7-806a-46ca-8f52-bd8056c9b030 req-cac3b1af-37c0-45ef-bdec-01ff42b73bdb service nova] Enqueued Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 657.395707] env[65992]: INFO networking_nsxv3.common.synchronization [req-a74c03c7-806a-46ca-8f52-bd8056c9b030 req-cac3b1af-37c0-45ef-bdec-01ff42b73bdb service nova] Enqueued Resource ID: 784d2c25-9879-46f9-b227-ca88d2f3aab0 with Priority: HIGHEST for action port [ 657.400257] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_rules [ 657.400257] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 657.400257] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784d2c25-9879-46f9-b227-ca88d2f3aab0 with Priority: HIGHEST for action port [ 657.400257] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.400257] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.400257] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.400257] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.400257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.401201] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.402164] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-784d2c25-9879-46f9-b227-ca88d2f3aab0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.402528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-784d2c25-9879-46f9-b227-ca88d2f3aab0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.402752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-784d2c25-9879-46f9-b227-ca88d2f3aab0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.403078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-784d2c25-9879-46f9-b227-ca88d2f3aab0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.403465] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('784d2c25-9879-46f9-b227-ca88d2f3aab0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.905019] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.906273] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.906401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.906585] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 784d2c25-9879-46f9-b227-ca88d2f3aab0 with status ACTIVE [ 657.906767] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.906893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.906966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.907268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.907361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.907534] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.907631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.907686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.907846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.907922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.909593] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.909593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.909593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.909593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.909593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.909593] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 784d2c25-9879-46f9-b227-ca88d2f3aab0 is going to be updated. [ 657.934543] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.934801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.934801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.934961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.935224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.935993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-784d2c25-9879-46f9-b227-ca88d2f3aab0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.352371] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: SUCCESS [ 658.352371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.352371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.352371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.352635] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.352895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.352895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.353092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.353224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.353313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.353474] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.412217] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.862612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.862612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.862612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.862919] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.863173] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.863372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.863465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.863789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.864110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.864269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.864507] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.864681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.864773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.865713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.866014] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.866117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.866186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.866373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.866536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.866669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.866783] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.917941] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.917941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.917941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.917941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.917941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.917941] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c is going to be created. [ 658.945561] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.945700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.945700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.945970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.946301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.958776] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: UNINITIALIZED for 2s [ 659.369928] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdc7601c-fb13-4bed-8af5-454bff4da6cf: rpc.has_security_group_logging(os_id): False [ 659.388879] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.389255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.389255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.390309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.390309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.390309] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.390309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.390309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.390309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.390309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.390613] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.390613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.390613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.390613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.390773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.390860] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.390949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.391015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.391152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.391225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.391325] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be updated. [ 659.459717] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.460331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.460331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.460331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.460331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.477336] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: IN_PROGRESS for 2s [ 660.887915] env[65992]: INFO networking_nsxv3.common.synchronization [req-45f0a39a-cae1-4f9f-9ae0-7b0c38cf2dae req-f0c395a5-9947-48c2-8aee-7bbe9eefbb63 tempest-SecurityGroupRulesNegativeTestJSON-1984127239 tempest-SecurityGroupRulesNegativeTestJSON-1984127239-project-member] Enqueued Resource ID: b4804450-5491-42a2-8495-7f2864a7d814 with Priority: HIGHEST for action security_group_rules [ 660.888615] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4804450-5491-42a2-8495-7f2864a7d814 with Priority: HIGHEST for action security_group_rules [ 660.889152] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4804450-5491-42a2-8495-7f2864a7d814 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.892953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4804450-5491-42a2-8495-7f2864a7d814" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.892953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4804450-5491-42a2-8495-7f2864a7d814" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.892953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4804450-5491-42a2-8495-7f2864a7d814" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.892953] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4804450-5491-42a2-8495-7f2864a7d814',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.968968] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: SUCCESS [ 660.969498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.969498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.969642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.969795] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.969931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.969978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.970162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.970276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.970406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.970646] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.416558] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.416558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.416558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.417020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.417020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.417286] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4804450-5491-42a2-8495-7f2864a7d814 already deleted. [ 661.417286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4804450-5491-42a2-8495-7f2864a7d814" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.507367] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.507367] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.507367] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.507367] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.507367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.509081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.509081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.509081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.509081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.509081] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.509081] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: SUCCESS [ 661.509081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.980204] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c: rpc.has_security_group_logging(os_id): False [ 662.001682] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.001789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.001789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.002175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.002175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.002397] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.002515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.002600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.002801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.002902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.003180] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.003297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.003376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.003558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.006230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.006230] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.006230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.006230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.006230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.006230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.006230] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c is going to be created. [ 662.083463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.083463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.083463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.083764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.084660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.100471] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: IN_PROGRESS for 2s [ 662.338282] env[65992]: INFO networking_nsxv3.common.synchronization [req-2489d823-6606-411e-a8bf-370054b9563a req-55e17f50-9b75-4d16-9ba5-312d143e7353 tempest-DeleteServersAdminTestJSON-1602258422 tempest-DeleteServersAdminTestJSON-1602258422-project-member] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 662.338929] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGHEST for action security_group_members [ 662.341700] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.341700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.341700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.341700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.341700] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.341700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.341700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.341700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.341700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.341700] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.848771] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.848771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.848771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.848771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.848771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.848771] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.848771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.848771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.848771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.848771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.848771] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f is going to be updated. [ 662.888749] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.888749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.888749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.888749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.888749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.900114] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: IN_PROGRESS for 2s [ 663.070396] env[65992]: INFO networking_nsxv3.common.synchronization [req-28d7a523-83ec-4a11-94b8-ca33c36b1f8d req-bb4ebc5a-cefa-4f4e-aca5-becb940d90e4 tempest-ServerGroupTestJSON-798125847 tempest-ServerGroupTestJSON-798125847-project-member] Enqueued Resource ID: 7883ea2f-8e33-46ff-9d56-25973809f24b with Priority: HIGHEST for action security_group_members [ 663.070396] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7883ea2f-8e33-46ff-9d56-25973809f24b with Priority: HIGHEST for action security_group_members [ 663.070747] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7883ea2f-8e33-46ff-9d56-25973809f24b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.070747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.070747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.071661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.072107] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.072421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.072421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.072635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.072767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.072894] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7883ea2f-8e33-46ff-9d56-25973809f24b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.578752] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.578752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.578752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.578752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.578752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.578752] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.578752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.578752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.578752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.578752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.579411] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7883ea2f-8e33-46ff-9d56-25973809f24b already deleted. [ 663.579411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.746178] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.746368] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-139" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.746485] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-139" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.746806] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-139" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.747391] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.747588] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.747701] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.747922] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.748075] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.748364] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.748478] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.748596] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.748698] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.748802] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.748901] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.749047] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.770642] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.770872] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.771034] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.771213] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-139" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.774560] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.774560] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.774560] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.774560] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.774560] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.115919] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: SUCCESS [ 664.116538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.276789] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.277036] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.277198] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.277497] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.277647] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.277790] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f not found, creating... [ 664.278054] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.278208] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.278319] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.278555] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.278682] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.278963] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.279127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.279232] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.279468] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.279609] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.279744] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f is going to be created. [ 664.300776] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.301054] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.301184] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.301566] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.301875] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.302122] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.911994] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76f6dffd-94d6-4a01-8082-da146608e51f in Status: SUCCESS [ 664.912202] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f deletion is rescheduled due to dependency. [ 664.912328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.042058] env[65992]: INFO networking_nsxv3.common.synchronization [req-28d7a523-83ec-4a11-94b8-ca33c36b1f8d req-a7ca4d29-21e2-47cd-b9e8-9d1a02cf391b service nova] Enqueued Resource ID: 7883ea2f-8e33-46ff-9d56-25973809f24b with Priority: HIGHEST for action security_group_rules [ 665.042347] env[65992]: INFO networking_nsxv3.common.synchronization [req-28d7a523-83ec-4a11-94b8-ca33c36b1f8d req-a7ca4d29-21e2-47cd-b9e8-9d1a02cf391b service nova] Enqueued Resource ID: 7883ea2f-8e33-46ff-9d56-25973809f24b with Priority: HIGHEST for action security_group_members [ 665.042519] env[65992]: INFO networking_nsxv3.common.synchronization [req-28d7a523-83ec-4a11-94b8-ca33c36b1f8d req-a7ca4d29-21e2-47cd-b9e8-9d1a02cf391b service nova] Enqueued Resource ID: bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f with Priority: HIGHEST for action port [ 665.043138] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7883ea2f-8e33-46ff-9d56-25973809f24b with Priority: HIGHEST for action security_group_rules [ 665.043325] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7883ea2f-8e33-46ff-9d56-25973809f24b with Priority: HIGHEST for action security_group_members [ 665.043419] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f with Priority: HIGHEST for action port [ 665.043867] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7883ea2f-8e33-46ff-9d56-25973809f24b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.043867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.044101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.044278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.044375] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7883ea2f-8e33-46ff-9d56-25973809f24b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.045362] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7883ea2f-8e33-46ff-9d56-25973809f24b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.045564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.045627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.045774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.046324] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.046324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.046324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.046324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.046324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.048522] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7883ea2f-8e33-46ff-9d56-25973809f24b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.050060] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.050203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.050259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.050684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.050684] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.552387] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7883ea2f-8e33-46ff-9d56-25973809f24b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.552785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.552785] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7883ea2f-8e33-46ff-9d56-25973809f24b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.554104] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f with status ACTIVE [ 665.554581] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.554581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.554581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.555090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.555090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.555241] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.555383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.555383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.557351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.557351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.557351] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.557351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.557351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.557351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.557351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.557351] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f is going to be updated. [ 665.583828] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.583828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.583828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.583828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.583828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.583828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc8bb854-6fab-4ffd-8a9e-1a0829af9c1f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.640027] env[65992]: INFO networking_nsxv3.common.synchronization [req-ba659eb9-ba4f-4cc1-bbce-d9d72d260d23 req-b960a5fd-dc75-4a30-9022-f11f5d14ffa0 tempest-ListServerFiltersTestJSON-1509451299 tempest-ListServerFiltersTestJSON-1509451299-project-member] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 665.640027] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 665.640027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.640027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.640027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.640870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.641212] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.642766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.642766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.642766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.642766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.642766] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.963384] env[65992]: INFO networking_nsxv3.common.synchronization [None req-893ef053-83de-4ed0-9a19-f57ab3c4ceca None None] Enqueued Resource ID: 250c4d20-22d4-42eb-b309-af41506a8e8a with Priority: HIGHEST for action port [ 665.963914] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250c4d20-22d4-42eb-b309-af41506a8e8a with Priority: HIGHEST for action port [ 665.964227] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-250c4d20-22d4-42eb-b309-af41506a8e8a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.964348] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-250c4d20-22d4-42eb-b309-af41506a8e8a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.964412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-250c4d20-22d4-42eb-b309-af41506a8e8a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.964700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-250c4d20-22d4-42eb-b309-af41506a8e8a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.964781] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('250c4d20-22d4-42eb-b309-af41506a8e8a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.058493] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7883ea2f-8e33-46ff-9d56-25973809f24b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.144870] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.145264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.145462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.145963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.145963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.146106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.146887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.146887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.146887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.147102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.147102] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 already deleted. [ 666.147102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.174737] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.175117] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.175383] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.175903] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.176388] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.176755] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.176970] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.177354] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.177534] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.177942] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.178095] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.178319] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.178519] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.178648] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.178751] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.178880] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.200876] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.203024] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.203024] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.203024] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.203024] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-ea206a74-3e91-4f06-89b0-8e8410ff997d taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.203024] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-ea206a74-3e91-4f06-89b0-8e8410ff997d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.203024] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-ea206a74-3e91-4f06-89b0-8e8410ff997d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.203024] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-ea206a74-3e91-4f06-89b0-8e8410ff997d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.203024] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea206a74-3e91-4f06-89b0-8e8410ff997d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.466529] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 250c4d20-22d4-42eb-b309-af41506a8e8a [ 666.467443] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.467443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.467443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.467443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.467443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.467763] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:250c4d20-22d4-42eb-b309-af41506a8e8a already deleted. [ 666.467763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-250c4d20-22d4-42eb-b309-af41506a8e8a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.561644] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.562025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.562025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.562183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.562518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.562518] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7883ea2f-8e33-46ff-9d56-25973809f24b is going to be created. [ 666.589095] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.589310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.589365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.589640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.589820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.601027] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7883ea2f-8e33-46ff-9d56-25973809f24b in Status: UNINITIALIZED for 2s [ 666.706854] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.707249] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.707389] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.707679] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.707823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.707971] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port ea206a74-3e91-4f06-89b0-8e8410ff997d not found, creating... [ 666.708347] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.708560] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.708667] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.708885] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.709028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.709321] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.709522] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.710245] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.710602] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.710754] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.710896] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: ea206a74-3e91-4f06-89b0-8e8410ff997d is going to be created. [ 666.765238] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.765502] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.765627] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.765899] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.766127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.766358] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-ea206a74-3e91-4f06-89b0-8e8410ff997d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.510505] env[65992]: INFO networking_nsxv3.common.synchronization [req-ba659eb9-ba4f-4cc1-bbce-d9d72d260d23 req-8da5f1b0-b2f5-4f5c-81a7-2c6860781e04 service nova] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_rules [ 667.510505] env[65992]: INFO networking_nsxv3.common.synchronization [req-ba659eb9-ba4f-4cc1-bbce-d9d72d260d23 req-8da5f1b0-b2f5-4f5c-81a7-2c6860781e04 service nova] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 667.510505] env[65992]: INFO networking_nsxv3.common.synchronization [req-ba659eb9-ba4f-4cc1-bbce-d9d72d260d23 req-8da5f1b0-b2f5-4f5c-81a7-2c6860781e04 service nova] Enqueued Resource ID: ea206a74-3e91-4f06-89b0-8e8410ff997d with Priority: HIGHEST for action port [ 667.510971] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_rules [ 667.511176] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 667.511333] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea206a74-3e91-4f06-89b0-8e8410ff997d with Priority: HIGHEST for action port [ 667.511601] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.511790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.511832] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.512091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.512192] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.513421] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.513591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.513630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.513834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.514105] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.514230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.514296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.514492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.514592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.515318] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.515527] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea206a74-3e91-4f06-89b0-8e8410ff997d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.515745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea206a74-3e91-4f06-89b0-8e8410ff997d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.515876] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea206a74-3e91-4f06-89b0-8e8410ff997d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.516065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea206a74-3e91-4f06-89b0-8e8410ff997d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.516142] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea206a74-3e91-4f06-89b0-8e8410ff997d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.737400] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8005293-9eeb-449f-ade7-bf4f83cfac7e req-e4a5eb60-1a4d-4adb-b4ea-bddcbc19b4e1 tempest-ServerPasswordTestJSON-1266448978 tempest-ServerPasswordTestJSON-1266448978-project-member] Enqueued Resource ID: aafaab8c-0f8b-4ded-b666-286994920d39 with Priority: HIGHEST for action security_group_members [ 667.739139] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafaab8c-0f8b-4ded-b666-286994920d39 with Priority: HIGHEST for action security_group_members [ 667.739749] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafaab8c-0f8b-4ded-b666-286994920d39 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.739924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.740027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.740343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.740510] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.740635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.740695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.740851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.741367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.741367] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafaab8c-0f8b-4ded-b666-286994920d39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.758486] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e48ae688-d674-4284-a77b-d1936a5a64bb None None] Enqueued Resource ID: 7755400b-0bf7-46d8-8b63-bc8de70c73df with Priority: HIGHEST for action port [ 667.758721] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7755400b-0bf7-46d8-8b63-bc8de70c73df with Priority: HIGHEST for action port [ 667.758822] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-7755400b-0bf7-46d8-8b63-bc8de70c73df taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.758941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7755400b-0bf7-46d8-8b63-bc8de70c73df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.759015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7755400b-0bf7-46d8-8b63-bc8de70c73df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.759293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7755400b-0bf7-46d8-8b63-bc8de70c73df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.759399] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7755400b-0bf7-46d8-8b63-bc8de70c73df',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.018648] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.018648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.018900] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.019601] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea206a74-3e91-4f06-89b0-8e8410ff997d with status ACTIVE [ 668.019790] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.019898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.019961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.020177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.020266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.021123] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.021123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.021123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.021123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.021123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.021123] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.021123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.021431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.021431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.021431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.021596] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea206a74-3e91-4f06-89b0-8e8410ff997d is going to be updated. [ 668.051262] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.051262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.051262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.051262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.051262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.051262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea206a74-3e91-4f06-89b0-8e8410ff997d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.199020] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.199020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-483" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.199020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-483" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.199020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-483" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.199020] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.199020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.199719] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.200895] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.200895] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.201173] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.201327] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.201586] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.201731] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.201875] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.202017] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.202183] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.220887] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.221084] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.221213] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.221379] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-483" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.221846] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-3db2d047-4455-481a-965b-dbc40edc5610 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.222055] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-3db2d047-4455-481a-965b-dbc40edc5610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.222179] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-3db2d047-4455-481a-965b-dbc40edc5610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.222485] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-3db2d047-4455-481a-965b-dbc40edc5610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.222612] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3db2d047-4455-481a-965b-dbc40edc5610',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.247716] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.247939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.248058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.248307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.248426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.248614] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.248736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.248809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.248929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.249045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.249118] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafaab8c-0f8b-4ded-b666-286994920d39 already deleted. [ 668.249199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.262145] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7755400b-0bf7-46d8-8b63-bc8de70c73df [ 668.262371] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.262596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.262692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.262927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.263031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.263108] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7755400b-0bf7-46d8-8b63-bc8de70c73df already deleted. [ 668.263183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7755400b-0bf7-46d8-8b63-bc8de70c73df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.524783] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.612049] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7883ea2f-8e33-46ff-9d56-25973809f24b in Status: SUCCESS [ 668.612268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.612383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.612626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.613679] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.613679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.613679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.613679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.613679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.613679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.613679] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7883ea2f-8e33-46ff-9d56-25973809f24b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.726816] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.727097] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.727267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.727572] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.727687] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.727831] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 3db2d047-4455-481a-965b-dbc40edc5610 not found, creating... [ 668.728119] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.728302] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.728418] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.728632] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.728764] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.729057] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.729233] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.729364] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.729575] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.729718] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.729857] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 3db2d047-4455-481a-965b-dbc40edc5610 is going to be created. [ 668.754123] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.754547] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.754547] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.754752] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.755118] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.755226] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-3db2d047-4455-481a-965b-dbc40edc5610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.026354] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.026571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.026615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.026793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.026879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.026973] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be created. [ 669.055267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.055267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.055267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.055267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.055267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.064749] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: UNINITIALIZED for 2s [ 669.116215] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7883ea2f-8e33-46ff-9d56-25973809f24b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.116371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.116475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.116901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.117131] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.117346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.117487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.117771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.117918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.118096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.118336] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7883ea2f-8e33-46ff-9d56-25973809f24b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.118480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.118579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.118796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.119395] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.119614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.119721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.119944] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.120239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.120424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.120615] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7883ea2f-8e33-46ff-9d56-25973809f24b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.482286] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8005293-9eeb-449f-ade7-bf4f83cfac7e req-867265c1-a8cb-432b-b9fb-8949b934fc46 service nova] Enqueued Resource ID: aafaab8c-0f8b-4ded-b666-286994920d39 with Priority: HIGHEST for action security_group_rules [ 669.482473] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8005293-9eeb-449f-ade7-bf4f83cfac7e req-867265c1-a8cb-432b-b9fb-8949b934fc46 service nova] Enqueued Resource ID: aafaab8c-0f8b-4ded-b666-286994920d39 with Priority: HIGHEST for action security_group_members [ 669.482601] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8005293-9eeb-449f-ade7-bf4f83cfac7e req-867265c1-a8cb-432b-b9fb-8949b934fc46 service nova] Enqueued Resource ID: 3db2d047-4455-481a-965b-dbc40edc5610 with Priority: HIGHEST for action port [ 669.483237] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafaab8c-0f8b-4ded-b666-286994920d39 with Priority: HIGHEST for action security_group_rules [ 669.483409] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafaab8c-0f8b-4ded-b666-286994920d39 with Priority: HIGHEST for action security_group_members [ 669.483542] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db2d047-4455-481a-965b-dbc40edc5610 with Priority: HIGHEST for action port [ 669.484080] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aafaab8c-0f8b-4ded-b666-286994920d39 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.484256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.484371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.484626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.484760] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aafaab8c-0f8b-4ded-b666-286994920d39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.486083] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafaab8c-0f8b-4ded-b666-286994920d39 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.486083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.486083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.486263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.486355] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.486439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.486521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.486835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.487102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.487238] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafaab8c-0f8b-4ded-b666-286994920d39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.488373] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-3db2d047-4455-481a-965b-dbc40edc5610 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.488373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3db2d047-4455-481a-965b-dbc40edc5610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.488373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3db2d047-4455-481a-965b-dbc40edc5610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.489387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3db2d047-4455-481a-965b-dbc40edc5610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.489506] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3db2d047-4455-481a-965b-dbc40edc5610',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.623188] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7883ea2f-8e33-46ff-9d56-25973809f24b: rpc.has_security_group_logging(os_id): False [ 669.645324] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.645507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.645588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.645824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.645907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.646153] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.646265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.646324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.646481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.646564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.646748] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.646881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.646929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.647078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.647157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.647389] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.647673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.647673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.647813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.647813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.647911] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7883ea2f-8e33-46ff-9d56-25973809f24b is going to be created. [ 669.725126] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.725414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.725486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.726034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.726034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.740406] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7883ea2f-8e33-46ff-9d56-25973809f24b in Status: IN_PROGRESS for 2s [ 669.991449] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafaab8c-0f8b-4ded-b666-286994920d39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.993094] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafaab8c-0f8b-4ded-b666-286994920d39 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.993287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.994023] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3db2d047-4455-481a-965b-dbc40edc5610 with status ACTIVE [ 669.994023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.994023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.994023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.994385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.994385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.994466] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.994519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.994622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.994717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.995334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.995334] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.995334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.995334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.995620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.995620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.995620] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3db2d047-4455-481a-965b-dbc40edc5610 is going to be updated. [ 670.015805] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca2de62b-20d7-4b35-81c3-2017f0d4247d req-1a1c3ff3-1559-4192-bae6-aa76d2bf8c79 tempest-ListServerFiltersTestJSON-1509451299 tempest-ListServerFiltersTestJSON-1509451299-project-member] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 670.018265] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 670.018265] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.018265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.023250] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.023391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.023451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.023676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.023808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.023968] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3db2d047-4455-481a-965b-dbc40edc5610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.453703] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f90411df-7974-41e0-bbe9-02f73f4b27f2 tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_rules [ 670.453703] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_rules [ 670.454273] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.454397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.454451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.454707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.454780] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.494922] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafaab8c-0f8b-4ded-b666-286994920d39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.752379] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.752594] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.752711] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.752974] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.753240] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.753394] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.753505] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.753721] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.753859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.754072] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.754179] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.754280] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.754383] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.754496] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.754610] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.754714] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.772777] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.772916] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.773033] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.773179] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.773474] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-f1da2608-bba0-4360-93f6-d4ed542189e9 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.773636] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-f1da2608-bba0-4360-93f6-d4ed542189e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.773744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-f1da2608-bba0-4360-93f6-d4ed542189e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.774065] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-f1da2608-bba0-4360-93f6-d4ed542189e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.774198] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1da2608-bba0-4360-93f6-d4ed542189e9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.974769] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.974998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.974998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.975385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.975487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.975593] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 already deleted. [ 670.975679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.997361] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.997765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.997765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.997765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.997938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.997999] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafaab8c-0f8b-4ded-b666-286994920d39 is going to be created. [ 671.021621] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.021621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.021621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.021841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.022964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.032848] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafaab8c-0f8b-4ded-b666-286994920d39 in Status: UNINITIALIZED for 2s [ 671.074738] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 671.075021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.075225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.075458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.075643] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.075758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.077024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.077024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.077024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.077024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.077024] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.077277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.077277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.077443] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.077541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.077599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.077738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.077803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.077901] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.277550] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.277866] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.277866] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.278140] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.278300] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.278482] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port f1da2608-bba0-4360-93f6-d4ed542189e9 not found, creating... [ 671.278746] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.278898] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.279018] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.279239] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.279370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.279715] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.279866] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.279999] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.280247] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.280374] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.280505] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: f1da2608-bba0-4360-93f6-d4ed542189e9 is going to be created. [ 671.319299] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.319652] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.319845] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.320335] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.320701] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.321229] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-f1da2608-bba0-4360-93f6-d4ed542189e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.579918] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.580174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.580354] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.748833] env[65992]: INFO networking_nsxv3.common.synchronization [None req-b5a9b6a2-543c-47c7-b4bb-54d795ad9f85 tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_rules [ 671.749060] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_rules [ 671.749405] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.749635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.749718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.749912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.749994] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.755910] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7883ea2f-8e33-46ff-9d56-25973809f24b in Status: SUCCESS [ 671.756341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.008890] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca2de62b-20d7-4b35-81c3-2017f0d4247d req-158737bc-c772-4701-afe0-862722367d61 service nova] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_rules [ 672.009267] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca2de62b-20d7-4b35-81c3-2017f0d4247d req-158737bc-c772-4701-afe0-862722367d61 service nova] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 672.009267] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca2de62b-20d7-4b35-81c3-2017f0d4247d req-158737bc-c772-4701-afe0-862722367d61 service nova] Enqueued Resource ID: f1da2608-bba0-4360-93f6-d4ed542189e9 with Priority: HIGHEST for action port [ 672.010013] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_rules [ 672.010013] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 672.010427] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1da2608-bba0-4360-93f6-d4ed542189e9 with Priority: HIGHEST for action port [ 672.010723] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.010848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.011154] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.012448] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.012708] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1da2608-bba0-4360-93f6-d4ed542189e9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.012855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1da2608-bba0-4360-93f6-d4ed542189e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.012932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1da2608-bba0-4360-93f6-d4ed542189e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.013117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1da2608-bba0-4360-93f6-d4ed542189e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.013200] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1da2608-bba0-4360-93f6-d4ed542189e9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.083091] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.273209] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.273439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.273439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.273646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.273721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.274129] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 already deleted. [ 672.274245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.515493] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1da2608-bba0-4360-93f6-d4ed542189e9 with status ACTIVE [ 672.517793] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.517793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.517793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.517793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.517793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.517793] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.517793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.517793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.517793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.517793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.517793] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.518238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.521603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.521603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.521603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.521603] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1da2608-bba0-4360-93f6-d4ed542189e9 is going to be updated. [ 672.554992] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.555185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.555231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.555478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.555567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.555830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1da2608-bba0-4360-93f6-d4ed542189e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.586663] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.586952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.586952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.587356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.587455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.587533] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 672.635300] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.635300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.635300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.635300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.635300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.662170] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 672.925524] env[65992]: INFO networking_nsxv3.common.synchronization [None req-81c06727-20da-4a24-974b-8887bcfe1259 None None] Enqueued Resource ID: 668aa2da-f99f-4290-ab42-a1d441797d97 with Priority: HIGHEST for action port [ 672.926317] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 668aa2da-f99f-4290-ab42-a1d441797d97 with Priority: HIGHEST for action port [ 672.926730] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-668aa2da-f99f-4290-ab42-a1d441797d97 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.926975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-668aa2da-f99f-4290-ab42-a1d441797d97" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.927096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-668aa2da-f99f-4290-ab42-a1d441797d97" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.927416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-668aa2da-f99f-4290-ab42-a1d441797d97" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.927533] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('668aa2da-f99f-4290-ab42-a1d441797d97',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.047346] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafaab8c-0f8b-4ded-b666-286994920d39 in Status: SUCCESS [ 673.047665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.047762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.048633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.048851] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.048972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.049044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.049216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.049291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.050078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.050155] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aafaab8c-0f8b-4ded-b666-286994920d39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.431500] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 668aa2da-f99f-4290-ab42-a1d441797d97 [ 673.431683] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.431827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.431890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.432173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.432307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.432369] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:668aa2da-f99f-4290-ab42-a1d441797d97 already deleted. [ 673.432422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-668aa2da-f99f-4290-ab42-a1d441797d97" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.554183] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafaab8c-0f8b-4ded-b666-286994920d39 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.554183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.554183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.554183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.554458] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.554458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.554575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.554698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.554820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.554921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.556204] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafaab8c-0f8b-4ded-b666-286994920d39 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.556204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.556204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.556204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.556578] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.556578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.556578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.556578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.557138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.557138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.557138] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aafaab8c-0f8b-4ded-b666-286994920d39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.010520] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e542fabd-913c-4547-98eb-425585942c87 None None] Enqueued Resource ID: 5c6bac59-5c4e-4d35-a7ea-f63d5736edb5 with Priority: HIGHEST for action port [ 674.010520] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6bac59-5c4e-4d35-a7ea-f63d5736edb5 with Priority: HIGHEST for action port [ 674.010933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c6bac59-5c4e-4d35-a7ea-f63d5736edb5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.011119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c6bac59-5c4e-4d35-a7ea-f63d5736edb5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.011211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c6bac59-5c4e-4d35-a7ea-f63d5736edb5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.011472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c6bac59-5c4e-4d35-a7ea-f63d5736edb5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.011548] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c6bac59-5c4e-4d35-a7ea-f63d5736edb5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.062211] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aafaab8c-0f8b-4ded-b666-286994920d39: rpc.has_security_group_logging(os_id): False [ 674.081902] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.082228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.082443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.082907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.083050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.083424] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.083691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.083842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.084078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.084212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.084474] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.084629] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.085458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.086690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.086865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.087140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.087612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.087757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.088026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.088365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.089320] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aafaab8c-0f8b-4ded-b666-286994920d39 is going to be created. [ 674.158451] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.158627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.158710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.158931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.159123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.177360] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafaab8c-0f8b-4ded-b666-286994920d39 in Status: IN_PROGRESS for 2s [ 674.514704] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c6bac59-5c4e-4d35-a7ea-f63d5736edb5 [ 674.514704] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.514704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.514704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.514704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.514704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.514704] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c6bac59-5c4e-4d35-a7ea-f63d5736edb5 already deleted. [ 674.514704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c6bac59-5c4e-4d35-a7ea-f63d5736edb5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.673874] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 674.674096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.674409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.674468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.674661] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.674776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.674835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.674987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.675072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.675170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.675360] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.675453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.675500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.675823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.675823] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.675939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.675939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.676102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.676200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.676271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.676355] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.677259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.677485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.677636] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.677754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.678061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.678061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.678061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.678185] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.182863] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3fb6b8-5af1-492f-992f-9183de28faa7: rpc.has_security_group_logging(os_id): False [ 675.182863] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.202416] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.202575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.202646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.202867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.202961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.203184] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.203316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.203357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.203496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.203537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.203721] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.203838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.203900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.207431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.208094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.208094] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.208094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.208094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.208387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.208387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.208387] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be created. [ 675.253573] env[65992]: INFO networking_nsxv3.common.synchronization [req-05426246-253a-4b55-9509-c2fd84d7ed31 req-88ce7cd0-cbf3-4469-9201-efda8ccdf19d tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 675.254248] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 675.254673] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.254837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.254892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.259188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.259382] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.259504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.259553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.260555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.260555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.260555] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.264792] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.264909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.264969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.265235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.265413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.277528] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 675.687103] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.755094] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.755425] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.755586] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.755933] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.757026] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.757026] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.757026] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.757277] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.757431] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.757686] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.757793] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.758265] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.758265] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.758265] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.758265] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.758455] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.763118] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.763264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.763341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.763551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.763658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.763812] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.763904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.763975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.764131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.764201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.764307] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 675.781191] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.781357] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.781483] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.781653] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.781960] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-a88d46c7-9b67-45b2-a436-4115db58ea76 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.782150] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-a88d46c7-9b67-45b2-a436-4115db58ea76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.782279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-a88d46c7-9b67-45b2-a436-4115db58ea76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.782591] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-a88d46c7-9b67-45b2-a436-4115db58ea76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.782722] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a88d46c7-9b67-45b2-a436-4115db58ea76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.796170] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.796326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.796397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.796612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.796750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.809262] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 676.190046] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.190046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.190046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.190046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.190770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.190770] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 676.194807] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafaab8c-0f8b-4ded-b666-286994920d39 in Status: SUCCESS [ 676.195094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.225837] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.226136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.226136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.226740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.226740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.248146] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 676.285517] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.286664] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.286664] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.286664] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.287327] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.287327] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port a88d46c7-9b67-45b2-a436-4115db58ea76 not found, creating... [ 676.287682] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.287997] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.288226] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.289126] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.289126] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.289367] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.289599] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.289887] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.290538] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.290538] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.290695] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: a88d46c7-9b67-45b2-a436-4115db58ea76 is going to be created. [ 676.334361] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.334828] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.335105] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.335593] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.335936] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.336709] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-a88d46c7-9b67-45b2-a436-4115db58ea76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.044309] env[65992]: INFO networking_nsxv3.common.synchronization [req-05426246-253a-4b55-9509-c2fd84d7ed31 req-d67faae0-6c97-4163-84b7-4095b1d28949 service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 677.044309] env[65992]: INFO networking_nsxv3.common.synchronization [req-05426246-253a-4b55-9509-c2fd84d7ed31 req-d67faae0-6c97-4163-84b7-4095b1d28949 service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 677.044309] env[65992]: INFO networking_nsxv3.common.synchronization [req-05426246-253a-4b55-9509-c2fd84d7ed31 req-d67faae0-6c97-4163-84b7-4095b1d28949 service nova] Enqueued Resource ID: a88d46c7-9b67-45b2-a436-4115db58ea76 with Priority: HIGHEST for action port [ 677.044309] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 677.044309] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 677.044309] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a88d46c7-9b67-45b2-a436-4115db58ea76 with Priority: HIGHEST for action port [ 677.044309] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.044309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.044309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.046481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.046481] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.047541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.047641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.047829] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a88d46c7-9b67-45b2-a436-4115db58ea76 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.047929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a88d46c7-9b67-45b2-a436-4115db58ea76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.047993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a88d46c7-9b67-45b2-a436-4115db58ea76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.048195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a88d46c7-9b67-45b2-a436-4115db58ea76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.048309] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a88d46c7-9b67-45b2-a436-4115db58ea76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.296864] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 677.297226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.298252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.298563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.298697] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.548167] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.549151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.550511] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a88d46c7-9b67-45b2-a436-4115db58ea76 with status ACTIVE [ 677.550710] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.550863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.550940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.551244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.551346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.551567] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.551699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.551791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.551960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.552064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.552267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.552365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.552479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.552562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.552633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.552723] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a88d46c7-9b67-45b2-a436-4115db58ea76 is going to be updated. [ 677.580990] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.581218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.581353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.581692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.581926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.582239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a88d46c7-9b67-45b2-a436-4115db58ea76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.774329] env[65992]: INFO networking_nsxv3.common.synchronization [req-4b2a2354-ede9-45f3-bbe4-7586a7831134 req-2e6fc12d-3895-4cc9-aa69-1166c2e2d49f tempest-ServersAdminNegativeTestJSON-1396292550 tempest-ServersAdminNegativeTestJSON-1396292550-project-member] Enqueued Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 677.774793] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 677.775275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.775407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.776044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.776044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.776044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.776044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.776044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.776367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.776367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.776444] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.801818] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.802149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.822561] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 677.822813] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 677.822813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.823124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.823236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.823468] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.823626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.823776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.823877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.823965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.824078] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.264128] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 678.264128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.264260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.264472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.264779] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.265123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.265244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.266033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.266033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.266033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.266033] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.279932] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.319228] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.319776] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.319776] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.320181] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.320326] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.320534] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.320673] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.321069] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.321160] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.321448] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.321625] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.321749] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.321918] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.322047] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.322189] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.322755] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.327821] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.344753] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.344933] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.345079] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.345311] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.345653] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-3d8d22b9-26d4-46e8-86f2-19465feea09c taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.345867] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-3d8d22b9-26d4-46e8-86f2-19465feea09c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.345988] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-3d8d22b9-26d4-46e8-86f2-19465feea09c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.346618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-3d8d22b9-26d4-46e8-86f2-19465feea09c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.346618] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8d22b9-26d4-46e8-86f2-19465feea09c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.429024] env[65992]: INFO networking_nsxv3.common.synchronization [None req-903ee1fd-63c0-403a-8084-b82556d493a7 None None] Enqueued Resource ID: 519d3bf0-c575-4fd3-95a8-b35b57a4cd2d with Priority: HIGHEST for action port [ 678.429024] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 519d3bf0-c575-4fd3-95a8-b35b57a4cd2d with Priority: HIGHEST for action port [ 678.429024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-519d3bf0-c575-4fd3-95a8-b35b57a4cd2d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.429024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-519d3bf0-c575-4fd3-95a8-b35b57a4cd2d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.429024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-519d3bf0-c575-4fd3-95a8-b35b57a4cd2d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.429024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-519d3bf0-c575-4fd3-95a8-b35b57a4cd2d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.429349] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('519d3bf0-c575-4fd3-95a8-b35b57a4cd2d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.769699] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.770086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.770181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.771153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.771153] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.771153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.771153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.771153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.772431] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.772431] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.772431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.772431] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.782206] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.832310] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.850040] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.851047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.851047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.851276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.851442] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.851603] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 3d8d22b9-26d4-46e8-86f2-19465feea09c not found, creating... [ 678.851915] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.852099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.853545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.853545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.853545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.853545] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.853545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.853545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.853545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.854335] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.854335] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 3d8d22b9-26d4-46e8-86f2-19465feea09c is going to be created. [ 678.881476] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.881707] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.881763] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.882128] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.883032] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.883032] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-3d8d22b9-26d4-46e8-86f2-19465feea09c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.932359] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 519d3bf0-c575-4fd3-95a8-b35b57a4cd2d [ 678.932620] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.932766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.932850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.933955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.933955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.933955] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:519d3bf0-c575-4fd3-95a8-b35b57a4cd2d already deleted. [ 678.933955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-519d3bf0-c575-4fd3-95a8-b35b57a4cd2d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.275135] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3fb6b8-5af1-492f-992f-9183de28faa7: rpc.has_security_group_logging(os_id): False [ 679.285389] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.285964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.285964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.285964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.286134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.286222] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b is going to be updated. [ 679.298577] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.298809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.298890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.299128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.299215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.299469] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.299583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.299643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.299804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.299883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.300115] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.300216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.300333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.300419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.300493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.300673] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.300765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.300822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.300959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.301045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.301142] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 679.323883] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.324258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.324258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.324404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.324555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.333706] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.333848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.333900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.334604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.334604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.334604] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 679.339480] env[65992]: INFO networking_nsxv3.common.synchronization [None req-8662b883-2438-4c3e-b98e-d8dca8930daa None None] Enqueued Resource ID: 2972e29a-95b6-4b51-a272-8a720d55e115 with Priority: HIGHEST for action port [ 679.340519] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: IN_PROGRESS for 2s [ 679.342736] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2972e29a-95b6-4b51-a272-8a720d55e115 with Priority: HIGHEST for action port [ 679.346331] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2972e29a-95b6-4b51-a272-8a720d55e115 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.346331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2972e29a-95b6-4b51-a272-8a720d55e115" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.346331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2972e29a-95b6-4b51-a272-8a720d55e115" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.346331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2972e29a-95b6-4b51-a272-8a720d55e115" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.346331] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2972e29a-95b6-4b51-a272-8a720d55e115',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.377501] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.378426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.378426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.378426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.378426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.380959] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.380959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.380959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.381134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.381232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.391168] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 679.394351] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 679.633417] env[65992]: INFO networking_nsxv3.common.synchronization [req-4b2a2354-ede9-45f3-bbe4-7586a7831134 req-39816868-d444-4e75-ad28-0d7178f4a30e service nova] Enqueued Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_rules [ 679.633417] env[65992]: INFO networking_nsxv3.common.synchronization [req-4b2a2354-ede9-45f3-bbe4-7586a7831134 req-39816868-d444-4e75-ad28-0d7178f4a30e service nova] Enqueued Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 679.633621] env[65992]: INFO networking_nsxv3.common.synchronization [req-4b2a2354-ede9-45f3-bbe4-7586a7831134 req-39816868-d444-4e75-ad28-0d7178f4a30e service nova] Enqueued Resource ID: 3d8d22b9-26d4-46e8-86f2-19465feea09c with Priority: HIGHEST for action port [ 679.634153] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_rules [ 679.634328] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 679.634457] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8d22b9-26d4-46e8-86f2-19465feea09c with Priority: HIGHEST for action port [ 679.634798] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.634891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.634982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.635355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.635355] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.637532] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.638524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.638524] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d8d22b9-26d4-46e8-86f2-19465feea09c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.638524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d8d22b9-26d4-46e8-86f2-19465feea09c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.638524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d8d22b9-26d4-46e8-86f2-19465feea09c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.638524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d8d22b9-26d4-46e8-86f2-19465feea09c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.638524] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8d22b9-26d4-46e8-86f2-19465feea09c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.645424] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c480a68c-96d8-442e-9831-41f1595f3f19 None None] Enqueued Resource ID: bd087c0e-abd2-4334-9cef-913a027d7054 with Priority: HIGHEST for action port [ 679.646062] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd087c0e-abd2-4334-9cef-913a027d7054 with Priority: HIGHEST for action port [ 679.646882] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd087c0e-abd2-4334-9cef-913a027d7054 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.646882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd087c0e-abd2-4334-9cef-913a027d7054" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.646882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd087c0e-abd2-4334-9cef-913a027d7054" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.646882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd087c0e-abd2-4334-9cef-913a027d7054" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.646882] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd087c0e-abd2-4334-9cef-913a027d7054',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.850801] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2972e29a-95b6-4b51-a272-8a720d55e115 [ 679.850801] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.850801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.850801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.850801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.850801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.850801] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2972e29a-95b6-4b51-a272-8a720d55e115 already deleted. [ 679.850801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2972e29a-95b6-4b51-a272-8a720d55e115" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.139188] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.139384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.144967] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d8d22b9-26d4-46e8-86f2-19465feea09c with status ACTIVE [ 680.146616] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.146786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.146899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.147222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.147375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.147588] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.147708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.147776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.147942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.148037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.148252] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.148443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.148443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.148600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.148678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.148783] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d8d22b9-26d4-46e8-86f2-19465feea09c is going to be updated. [ 680.150827] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd087c0e-abd2-4334-9cef-913a027d7054 [ 680.151065] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.151384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.151491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.151628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.151710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.151786] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd087c0e-abd2-4334-9cef-913a027d7054 already deleted. [ 680.151863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd087c0e-abd2-4334-9cef-913a027d7054" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.177208] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.177445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.177586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.178224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.178224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.178224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d8d22b9-26d4-46e8-86f2-19465feea09c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.356419] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: SUCCESS [ 681.356742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.356824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.357059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.357254] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.357400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.357455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.357614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.357711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.357815] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.402821] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 681.402821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.403032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.403245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.403490] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.403490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.403490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.403490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.403490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.403490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.404519] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.412433] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 681.412433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.860285] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.913720] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.913948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.913948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.914268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.914421] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.914536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.914604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.914761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.914833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.914933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.915121] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.915359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.915359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.915478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.915558] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.915646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.915707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.915861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.915937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.916030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.916122] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.365629] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.418635] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6866765e-0cdc-4d35-aa21-1b0f99339ef0: rpc.has_security_group_logging(os_id): False [ 682.440074] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.440363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.440462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.440730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.440887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.441251] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.441425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.441494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.441761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.441903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.442270] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.442442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.442553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.442824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.442960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.443354] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.443529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.443645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.443897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.444051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.444204] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 682.509780] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.509780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.509780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.510099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.510178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.529756] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 682.662874] env[65992]: INFO networking_nsxv3.common.synchronization [None req-7e1fe5dd-ad3a-40ee-837d-9439e32b28a3 None None] Enqueued Resource ID: 5a9b6043-aeb2-4081-8a11-03bb87d9a3f2 with Priority: HIGHEST for action port [ 682.663488] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9b6043-aeb2-4081-8a11-03bb87d9a3f2 with Priority: HIGHEST for action port [ 682.664229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a9b6043-aeb2-4081-8a11-03bb87d9a3f2 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.664381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a9b6043-aeb2-4081-8a11-03bb87d9a3f2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.664456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a9b6043-aeb2-4081-8a11-03bb87d9a3f2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.664715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a9b6043-aeb2-4081-8a11-03bb87d9a3f2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.664818] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a9b6043-aeb2-4081-8a11-03bb87d9a3f2',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.873039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.873039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.873039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.873039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.873039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.873039] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b is going to be updated. [ 682.907135] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.907399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.907399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.907605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.907742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.918522] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: IN_PROGRESS for 2s [ 683.167975] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a9b6043-aeb2-4081-8a11-03bb87d9a3f2 [ 683.168249] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.168459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.168562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.168733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.168823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.168936] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a9b6043-aeb2-4081-8a11-03bb87d9a3f2 already deleted. [ 683.169032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a9b6043-aeb2-4081-8a11-03bb87d9a3f2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.546651] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 684.547071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.931733] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: SUCCESS [ 684.931931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.932122] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.932387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.932583] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.932697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.932758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.932906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.932986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.933082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.933170] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.436094] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.436388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.436388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.436594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.436751] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.436840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.436899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.437018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.437105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.437183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.437380] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.437551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.437551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.437748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.437976] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.438156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.438318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.438471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.438563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.438649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.438738] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.940918] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa8c9176-c0d4-4732-93ba-a80e6182488b: rpc.has_security_group_logging(os_id): False [ 685.960953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.961257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.961257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.961575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.961722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.961970] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.962158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.962234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.962438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.962569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.962810] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.962925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.962998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.963164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.963242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.963460] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.963582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.963646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.963811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.963881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.963981] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b is going to be updated. [ 686.027215] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.027505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.027611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.027955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.028217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.047800] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: IN_PROGRESS for 2s [ 686.443865] env[65992]: INFO networking_nsxv3.common.synchronization [req-856cad20-21fe-4f20-bdbe-cf750d9531ea req-0e320889-63c4-4b2e-b514-2dd3783b5e59 tempest-ListServerFiltersTestJSON-1509451299 tempest-ListServerFiltersTestJSON-1509451299-project-member] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 686.444717] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 686.445219] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.445405] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.445495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.445780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.445992] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.446137] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.446219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.446417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.446533] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.446655] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.801478] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-566 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.801705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.801777] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.802056] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.802358] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.802530] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.802654] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.802848] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.802975] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.803194] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.803298] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.803397] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.803497] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.803593] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.803686] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.803809] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.823940] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.824192] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.824308] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.824491] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-566" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.824821] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.825043] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.825174] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.825522] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.825694] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.950177] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.328090] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.328425] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.328521] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.328788] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.328932] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.329084] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0 not found, creating... [ 687.329344] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.329504] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.329604] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.329848] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.329969] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.330269] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.330418] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.330531] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.330737] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.330861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.330993] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0 is going to be created. [ 687.360254] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.360619] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.360761] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.361189] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.361727] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.361869] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.453390] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.956229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.956672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.956672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.956756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.957038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.957038] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 687.990804] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.990969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.991197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.991353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.991562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.002912] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 688.065044] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: SUCCESS [ 688.065308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.070656] env[65992]: INFO networking_nsxv3.common.synchronization [req-856cad20-21fe-4f20-bdbe-cf750d9531ea req-2506e9f7-dd49-46a9-af41-c8082bdf70b1 service nova] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_rules [ 688.070947] env[65992]: INFO networking_nsxv3.common.synchronization [req-856cad20-21fe-4f20-bdbe-cf750d9531ea req-2506e9f7-dd49-46a9-af41-c8082bdf70b1 service nova] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 688.071149] env[65992]: INFO networking_nsxv3.common.synchronization [req-856cad20-21fe-4f20-bdbe-cf750d9531ea req-2506e9f7-dd49-46a9-af41-c8082bdf70b1 service nova] Enqueued Resource ID: a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0 with Priority: HIGHEST for action port [ 688.073012] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_rules [ 688.073012] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 688.073312] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0 with Priority: HIGHEST for action port [ 688.074901] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.074901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.074901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.074901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.074901] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.076201] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.076314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.076637] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.076753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.076845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.077223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.077223] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.579307] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.579307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.579578] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0 with status ACTIVE [ 688.579727] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.579888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.579958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.580187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.580277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.580453] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.580646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.580646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.580759] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.580827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.581015] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.581113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.581172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.581310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.581540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.581658] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0 is going to be updated. [ 688.606648] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.606951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.606951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.607158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.607266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.607500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6d5a61e-3ee9-4e7f-b7ab-4a2e18eb39d0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.007431] env[65992]: INFO networking_nsxv3.common.synchronization [req-c3fcf15b-e543-4724-bf4c-5f5e3094ef2d req-2fbc3d30-68f8-40de-b90b-3d075cf79ebe tempest-ServersTestBootFromVolume-1851510878 tempest-ServersTestBootFromVolume-1851510878-project-member] Enqueued Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_members [ 690.008933] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_members [ 690.009314] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.009467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.009577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.009894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.010129] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.010267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.010330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.010549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.010637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.010745] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.017032] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 690.017032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.017260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.018038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.018038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.018038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.018038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.018357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.018357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.018357] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.395693] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.396489] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-396" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.396675] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-396" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.396979] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-396" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.397317] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.397470] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.397587] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.398797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.399043] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.399164] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.399226] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.399313] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.399414] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.399515] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.399749] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.399877] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.422342] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.422511] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 690.422643] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.422824] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-396" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.423208] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.423387] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.423554] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.423824] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.423959] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.514124] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.514124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.514124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.514124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.514124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.514124] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.514443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.514443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.514518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.514588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.514791] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 already deleted. [ 690.514891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.549692] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.928965] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.929342] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.930270] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.930270] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.930270] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.930488] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5 not found, creating... [ 690.930826] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.931096] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.931275] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.932038] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.932038] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.935697] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.935834] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.935969] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.936677] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.936677] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.936677] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5 is going to be created. [ 690.963638] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.963951] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.965858] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.965858] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.965858] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.965858] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.024428] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.476324] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d5032eba-5208-421a-87a1-355cd4891986 tempest-ServersTestFqdnHostnames-1006644802 tempest-ServersTestFqdnHostnames-1006644802-project-member] Enqueued Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_rules [ 691.476872] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_rules [ 691.477185] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.477340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.477460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.477675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.477756] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.525971] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.526385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.526385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.526600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.526755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.526799] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 691.575030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.575030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.575030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.575030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.575030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.586793] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 691.685096] env[65992]: INFO networking_nsxv3.common.synchronization [None req-2d909907-ba6b-48f8-ba31-a04e9e1419ff tempest-ServersTestFqdnHostnames-1006644802 tempest-ServersTestFqdnHostnames-1006644802-project-member] Enqueued Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_rules [ 691.685096] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_rules [ 691.685096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.685096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.765389] env[65992]: INFO networking_nsxv3.common.synchronization [req-c3fcf15b-e543-4724-bf4c-5f5e3094ef2d req-5041d22b-755d-4e6c-a459-8c1b554d1927 service nova] Enqueued Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_rules [ 691.765547] env[65992]: INFO networking_nsxv3.common.synchronization [req-c3fcf15b-e543-4724-bf4c-5f5e3094ef2d req-5041d22b-755d-4e6c-a459-8c1b554d1927 service nova] Enqueued Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_members [ 691.765682] env[65992]: INFO networking_nsxv3.common.synchronization [req-c3fcf15b-e543-4724-bf4c-5f5e3094ef2d req-5041d22b-755d-4e6c-a459-8c1b554d1927 service nova] Enqueued Resource ID: c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5 with Priority: HIGHEST for action port [ 691.766274] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_rules [ 691.766402] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_members [ 691.766504] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5 with Priority: HIGHEST for action port [ 691.766807] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.766929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.766994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.767202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.767282] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.768221] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.768332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.768444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.768673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.768825] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.768922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.769055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.769150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.769230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.769321] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.770965] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.770965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.770965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.770965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.770965] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.002227] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.002481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.002648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.002949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.003183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.003525] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce already deleted. [ 692.003957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.004123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.004427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.004677] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.272475] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.272840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.272977] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.274282] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5 with status ACTIVE [ 692.274580] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.274763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.274871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.275249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.275400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.275670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.275833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.275931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.276198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.276327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.276625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.276785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.276885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.277647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.277647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.277647] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5 is going to be updated. [ 692.312121] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.312339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.312440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.312749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.312956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.313210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7d559d2-af0b-4a3c-9a1d-d65b5ea578a5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.534435] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.534435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.535386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.535785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.535915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.536040] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce already deleted. [ 692.538098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.782442] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.861252] env[65992]: INFO networking_nsxv3.common.synchronization [req-fca53bc5-68f4-4fab-98a0-953d9318b2e1 req-a628f55d-b6e1-4a33-ae20-28cfdbd248f3 tempest-InstanceActionsTestJSON-55783644 tempest-InstanceActionsTestJSON-55783644-project-member] Enqueued Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGHEST for action security_group_members [ 692.861862] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGHEST for action security_group_members [ 692.862260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05766df-1b14-44a9-aa91-735a92b6816e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.865946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.866041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.866344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.868307] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.868464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.869268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.869268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.869268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.869268] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.288206] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.288557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.288557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.288837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.288974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.289134] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 is going to be created. [ 693.346048] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.346048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.346380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.346822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.346822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.360484] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 in Status: UNINITIALIZED for 2s [ 693.371419] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.371675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.371730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.372085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.372756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.372756] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.372756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.372756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.372756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.372989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.372989] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05766df-1b14-44a9-aa91-735a92b6816e already deleted. [ 693.373104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.420495] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.420744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-237" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.420794] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-237" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.421143] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-237" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.421396] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.421575] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.421651] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.422155] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.422349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.422741] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.422865] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.422970] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.423103] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.423233] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.423335] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.423463] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.446836] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.446999] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.447686] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.447882] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-237" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.448235] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-d9b85015-260e-4fac-8ce7-653425e820dc taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.448503] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-d9b85015-260e-4fac-8ce7-653425e820dc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.448671] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-d9b85015-260e-4fac-8ce7-653425e820dc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.449098] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-d9b85015-260e-4fac-8ce7-653425e820dc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.449395] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9b85015-260e-4fac-8ce7-653425e820dc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.601588] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 693.601898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.602118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.602345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.602546] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.602670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.602735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.602891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.602992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.603086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.603180] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.953458] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.953672] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.953785] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.954079] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.954217] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.954443] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port d9b85015-260e-4fac-8ce7-653425e820dc not found, creating... [ 693.954602] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.954747] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.954853] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.955077] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.955206] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.955527] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.955723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.955782] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.956092] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.956238] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.956689] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: d9b85015-260e-4fac-8ce7-653425e820dc is going to be created. [ 693.982257] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.982495] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.982597] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.982869] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.983120] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.983332] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-d9b85015-260e-4fac-8ce7-653425e820dc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.106616] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.106616] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.106744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.107012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.107235] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.107453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.107543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.107739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.107865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.107977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.108243] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.108356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.108437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.108722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.108907] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.109059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.109132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.109317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.109441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.109571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.109898] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.119725] env[65992]: INFO networking_nsxv3.common.synchronization [req-4604cfd7-baf1-47ea-a489-a5f4b5584cd2 req-09c00211-1930-477b-939e-a26cd33309a6 tempest-ServerGroupTestJSON-798125847 tempest-ServerGroupTestJSON-798125847-project-member] Enqueued Resource ID: 7883ea2f-8e33-46ff-9d56-25973809f24b with Priority: HIGHEST for action security_group_members [ 694.120438] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7883ea2f-8e33-46ff-9d56-25973809f24b with Priority: HIGHEST for action security_group_members [ 694.120801] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7883ea2f-8e33-46ff-9d56-25973809f24b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.120984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.121728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.122237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.122237] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.122370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.122462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.122617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.122715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.122811] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7883ea2f-8e33-46ff-9d56-25973809f24b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.614909] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3fb6b8-5af1-492f-992f-9183de28faa7: rpc.has_security_group_logging(os_id): False [ 694.628583] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.628769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.628840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.629074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.629166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.629568] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.629568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.629568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.629780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.629780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.629842] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7883ea2f-8e33-46ff-9d56-25973809f24b is going to be updated. [ 694.640745] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.640745] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.640745] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.640745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.641255] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.641255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.641255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.643336] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.643930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.644191] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 694.676022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.676022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.676022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.676022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.676022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.687220] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7883ea2f-8e33-46ff-9d56-25973809f24b in Status: IN_PROGRESS for 2s [ 694.721925] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.723163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.723163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.724186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.724186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.735839] env[65992]: INFO networking_nsxv3.common.synchronization [req-fca53bc5-68f4-4fab-98a0-953d9318b2e1 req-a25beb75-2c24-42d8-adeb-b4cd64aeb263 service nova] Enqueued Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGHEST for action security_group_rules [ 694.737604] env[65992]: INFO networking_nsxv3.common.synchronization [req-fca53bc5-68f4-4fab-98a0-953d9318b2e1 req-a25beb75-2c24-42d8-adeb-b4cd64aeb263 service nova] Enqueued Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGHEST for action security_group_members [ 694.739074] env[65992]: INFO networking_nsxv3.common.synchronization [req-fca53bc5-68f4-4fab-98a0-953d9318b2e1 req-a25beb75-2c24-42d8-adeb-b4cd64aeb263 service nova] Enqueued Resource ID: d9b85015-260e-4fac-8ce7-653425e820dc with Priority: HIGHEST for action port [ 694.739074] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGHEST for action security_group_rules [ 694.739397] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGHEST for action security_group_members [ 694.739467] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b85015-260e-4fac-8ce7-653425e820dc with Priority: HIGHEST for action port [ 694.739925] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c05766df-1b14-44a9-aa91-735a92b6816e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.740531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.740531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.740639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.740749] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.742700] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05766df-1b14-44a9-aa91-735a92b6816e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.742898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.743016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.743286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.743477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.743586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.743639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.743872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.744010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.744167] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.745153] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9b85015-260e-4fac-8ce7-653425e820dc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.745288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9b85015-260e-4fac-8ce7-653425e820dc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.745349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9b85015-260e-4fac-8ce7-653425e820dc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.745541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9b85015-260e-4fac-8ce7-653425e820dc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.745660] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9b85015-260e-4fac-8ce7-653425e820dc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.748657] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 695.249738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05766df-1b14-44a9-aa91-735a92b6816e taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.249860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.250092] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.251237] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9b85015-260e-4fac-8ce7-653425e820dc with status ACTIVE [ 695.251312] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.252856] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.252856] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.252856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.253240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.254840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.255555] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9b85015-260e-4fac-8ce7-653425e820dc is going to be updated. [ 695.286132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.286325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.286325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.287518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.287518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.287518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9b85015-260e-4fac-8ce7-653425e820dc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.373500] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 in Status: SUCCESS [ 695.373718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.373893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.374133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.374326] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.374445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.374511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.374660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.374741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.374823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.374913] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.673020] env[65992]: INFO networking_nsxv3.common.synchronization [req-6f54e7c6-0b7f-4c60-9fb5-98482f6b5f15 req-ec3e30f5-1331-4b9a-b338-befe31562e58 tempest-ImagesOneServerTestJSON-735956263 tempest-ImagesOneServerTestJSON-735956263-project-member] Enqueued Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGHEST for action security_group_members [ 695.675153] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGHEST for action security_group_members [ 695.675612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-469d7145-af55-48eb-8111-6e095de38d66 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.676699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.676864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.677185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.679250] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.679250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.679250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.679250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.679250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.679250] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.687959] env[65992]: INFO networking_nsxv3.common.synchronization [req-bd945a4f-b173-4f1a-a8b2-b2cde7b4831c req-71032868-763a-431a-910b-c9bb6bfe8e46 tempest-ServersWithSpecificFlavorTestJSON-1648883113 tempest-ServersWithSpecificFlavorTestJSON-1648883113-project-member] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 695.687959] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 695.687959] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.687959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.687959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.687959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.687959] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.688512] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.688672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.688901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.689100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.689267] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.758571] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.879833] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.180643] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.180643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.181147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.181432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.181520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.181763] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.181881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.183598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.183598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.183598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.183598] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 469d7145-af55-48eb-8111-6e095de38d66 already deleted. [ 696.183598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.193205] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.193372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.193549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.193761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.193846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.194057] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.194156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.194213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.194356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.194439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.194520] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be updated. [ 696.235022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.235022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.235022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.235022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.235022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.242493] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.242697] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-609" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.242815] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-609" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.244278] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-609" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.244682] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.244807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.244935] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.245801] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.245954] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.246187] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.246308] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.246411] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.246512] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.246635] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.246721] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.246862] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.249238] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: IN_PROGRESS for 2s [ 696.262556] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.262712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.262712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.262957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.263098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.263206] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05766df-1b14-44a9-aa91-735a92b6816e is going to be created. [ 696.275876] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.276149] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 696.276372] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.276595] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-609" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.276985] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-bed1e560-7d7a-439b-8e02-bbd7249f6bec taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.277198] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-bed1e560-7d7a-439b-8e02-bbd7249f6bec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.277400] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-bed1e560-7d7a-439b-8e02-bbd7249f6bec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.277910] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-bed1e560-7d7a-439b-8e02-bbd7249f6bec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.278544] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed1e560-7d7a-439b-8e02-bbd7249f6bec',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.333220] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.334365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.334476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.334707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.336579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.349445] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05766df-1b14-44a9-aa91-735a92b6816e in Status: UNINITIALIZED for 2s [ 696.384110] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8dbe3c7f-5b13-4659-b2e7-18c87792b278: rpc.has_security_group_logging(os_id): False [ 696.415768] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.416114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.416332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.416646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.416891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.418753] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.419975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.419975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.419975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.419975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.419975] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 is going to be created. [ 696.512145] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.512145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.512145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.512145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.512145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.522810] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 in Status: IN_PROGRESS for 2s [ 696.697359] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7883ea2f-8e33-46ff-9d56-25973809f24b in Status: SUCCESS [ 696.697694] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7883ea2f-8e33-46ff-9d56-25973809f24b deletion is rescheduled due to dependency. [ 696.697733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7883ea2f-8e33-46ff-9d56-25973809f24b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.763598] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 696.763598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.780403] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.780637] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.780754] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.781034] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.781181] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.781327] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port bed1e560-7d7a-439b-8e02-bbd7249f6bec not found, creating... [ 696.781574] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.781836] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.781970] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.782238] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.782492] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.782667] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.782909] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.783072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.783231] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.783335] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.783473] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: bed1e560-7d7a-439b-8e02-bbd7249f6bec is going to be created. [ 696.803388] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.803587] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.803708] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.803976] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.804201] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.804414] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-bed1e560-7d7a-439b-8e02-bbd7249f6bec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.503321] env[65992]: INFO networking_nsxv3.common.synchronization [req-f07bc171-1774-4e39-9557-c898cc6fab7f req-7f722315-c884-4a46-8817-728a3e23128c tempest-ServerPasswordTestJSON-1266448978 tempest-ServerPasswordTestJSON-1266448978-project-member] Enqueued Resource ID: aafaab8c-0f8b-4ded-b666-286994920d39 with Priority: HIGHEST for action security_group_members [ 697.503889] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafaab8c-0f8b-4ded-b666-286994920d39 with Priority: HIGHEST for action security_group_members [ 697.504250] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafaab8c-0f8b-4ded-b666-286994920d39 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.504376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.504436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.504679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.504800] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.504872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.504935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.505124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.505232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.505331] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafaab8c-0f8b-4ded-b666-286994920d39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.542029] env[65992]: INFO networking_nsxv3.common.synchronization [req-6f54e7c6-0b7f-4c60-9fb5-98482f6b5f15 req-6d37b47e-4889-4d8a-9d83-ff1cac297247 service nova] Enqueued Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGHEST for action security_group_rules [ 697.542029] env[65992]: INFO networking_nsxv3.common.synchronization [req-6f54e7c6-0b7f-4c60-9fb5-98482f6b5f15 req-6d37b47e-4889-4d8a-9d83-ff1cac297247 service nova] Enqueued Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGHEST for action security_group_members [ 697.542029] env[65992]: INFO networking_nsxv3.common.synchronization [req-6f54e7c6-0b7f-4c60-9fb5-98482f6b5f15 req-6d37b47e-4889-4d8a-9d83-ff1cac297247 service nova] Enqueued Resource ID: bed1e560-7d7a-439b-8e02-bbd7249f6bec with Priority: HIGHEST for action port [ 697.542213] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGHEST for action security_group_rules [ 697.542535] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGHEST for action security_group_members [ 697.542692] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed1e560-7d7a-439b-8e02-bbd7249f6bec with Priority: HIGHEST for action port [ 697.543239] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-469d7145-af55-48eb-8111-6e095de38d66 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.543396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.543484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.543756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.543845] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.544797] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-469d7145-af55-48eb-8111-6e095de38d66 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.544942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.545025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.545191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.545340] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.545437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.545626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.546524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.546625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.546864] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.548709] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bed1e560-7d7a-439b-8e02-bbd7249f6bec taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.548835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bed1e560-7d7a-439b-8e02-bbd7249f6bec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.548896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bed1e560-7d7a-439b-8e02-bbd7249f6bec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.549061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bed1e560-7d7a-439b-8e02-bbd7249f6bec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.549138] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed1e560-7d7a-439b-8e02-bbd7249f6bec',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.008516] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.008814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.008814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.009088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.009394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.009559] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.009668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.009787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.010090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.010180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.010283] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafaab8c-0f8b-4ded-b666-286994920d39 is going to be updated. [ 698.046400] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.046400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.046400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.046400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.046400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.052362] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-469d7145-af55-48eb-8111-6e095de38d66 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.052362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.052362] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.052362] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bed1e560-7d7a-439b-8e02-bbd7249f6bec with status ACTIVE [ 698.052362] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.052362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.052657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.052657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.052720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.052852] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.053124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.053124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.053730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.053730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.053885] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.053982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.054055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.054207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.054283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.054368] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bed1e560-7d7a-439b-8e02-bbd7249f6bec is going to be updated. [ 698.056175] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafaab8c-0f8b-4ded-b666-286994920d39 in Status: IN_PROGRESS for 2s [ 698.082718] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.082956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.082997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.083272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.083480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.083661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bed1e560-7d7a-439b-8e02-bbd7249f6bec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.262287] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: SUCCESS [ 698.262557] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 deletion is rescheduled due to dependency. [ 698.262686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.360159] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05766df-1b14-44a9-aa91-735a92b6816e in Status: SUCCESS [ 698.360722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.360722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.360722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.361324] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.362126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.362126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.362126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.362126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.362126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.362126] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.539057] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 in Status: SUCCESS [ 698.539315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.556367] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.762014] env[65992]: INFO networking_nsxv3.common.synchronization [req-aa705f36-a9ed-4e02-84a7-d7b454c4762c req-55b5a09f-0880-4bd6-a503-fcb26f24b025 tempest-TenantUsagesTestJSON-812525012 tempest-TenantUsagesTestJSON-812525012-project-member] Enqueued Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGHEST for action security_group_members [ 698.762554] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGHEST for action security_group_members [ 698.762877] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-86094f9a-f281-4ae9-afd9-486fd3324728 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.763016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.763134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.763326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.764109] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.764248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.764305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.764464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.764610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.764667] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.864676] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05766df-1b14-44a9-aa91-735a92b6816e taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.864917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.866243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.866517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.866702] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.866817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.866881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.867044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.867136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.867580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.867962] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05766df-1b14-44a9-aa91-735a92b6816e taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.868087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.869171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.869343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.869498] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.869598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.869662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.870046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.870135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.870243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.870299] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.059086] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.059086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.059086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.059481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.059481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.059481] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 469d7145-af55-48eb-8111-6e095de38d66 is going to be created. [ 699.091019] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.091253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.091367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.091818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.092813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.105406] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 469d7145-af55-48eb-8111-6e095de38d66 in Status: UNINITIALIZED for 2s [ 699.269195] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.269195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.269195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.269403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.269403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.269563] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.269674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.269734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.269891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.270330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.270513] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86094f9a-f281-4ae9-afd9-486fd3324728 already deleted. [ 699.270619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.373163] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c05766df-1b14-44a9-aa91-735a92b6816e: rpc.has_security_group_logging(os_id): False [ 699.391154] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.391315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.391352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.391575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.391661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.391891] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.392153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.392153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.392273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.392273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.392450] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.392606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.392606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.392718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.392786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.392958] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.393063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.393122] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.393254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.393332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.393401] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c05766df-1b14-44a9-aa91-735a92b6816e is going to be created. [ 699.462090] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.462230] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.462402] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.462612] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.462855] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.462996] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.463331] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.463418] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.463569] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.463789] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.463918] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.464055] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.464164] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.464270] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.464529] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.464583] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.466532] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.466665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.466726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.466923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.467767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.480822] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c05766df-1b14-44a9-aa91-735a92b6816e in Status: IN_PROGRESS for 2s [ 699.488595] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.488663] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 699.488859] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.489019] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.489367] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-8ece435b-4059-4b6d-8560-25f11d22bcbd taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.489585] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-8ece435b-4059-4b6d-8560-25f11d22bcbd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.489717] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-8ece435b-4059-4b6d-8560-25f11d22bcbd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.491879] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-8ece435b-4059-4b6d-8560-25f11d22bcbd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.492259] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ece435b-4059-4b6d-8560-25f11d22bcbd',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.720923] env[65992]: INFO networking_nsxv3.common.synchronization [None req-97c5bb0a-6196-4992-84d5-a00fe7666b5c None None] Enqueued Resource ID: fca8b634-6bd0-4ec7-ad6e-30ac6455320c with Priority: HIGHEST for action port [ 699.721479] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca8b634-6bd0-4ec7-ad6e-30ac6455320c with Priority: HIGHEST for action port [ 699.721795] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-fca8b634-6bd0-4ec7-ad6e-30ac6455320c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.721916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fca8b634-6bd0-4ec7-ad6e-30ac6455320c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.721981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fca8b634-6bd0-4ec7-ad6e-30ac6455320c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.722603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fca8b634-6bd0-4ec7-ad6e-30ac6455320c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.722717] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca8b634-6bd0-4ec7-ad6e-30ac6455320c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.995107] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.995361] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.995510] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.995792] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.995990] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.996161] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 8ece435b-4059-4b6d-8560-25f11d22bcbd not found, creating... [ 699.996414] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.996566] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.996674] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.996891] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.997027] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.997308] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.997503] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.997621] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.997820] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.997959] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.998123] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 8ece435b-4059-4b6d-8560-25f11d22bcbd is going to be created. [ 700.021072] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.021277] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.021394] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.021666] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.021902] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.022145] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-8ece435b-4059-4b6d-8560-25f11d22bcbd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.070267] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafaab8c-0f8b-4ded-b666-286994920d39 in Status: SUCCESS [ 700.070267] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafaab8c-0f8b-4ded-b666-286994920d39 deletion is rescheduled due to dependency. [ 700.070267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafaab8c-0f8b-4ded-b666-286994920d39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.224713] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fca8b634-6bd0-4ec7-ad6e-30ac6455320c [ 700.224968] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.225206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.225260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.225493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.225689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.225689] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fca8b634-6bd0-4ec7-ad6e-30ac6455320c already deleted. [ 700.225758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fca8b634-6bd0-4ec7-ad6e-30ac6455320c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.751194] env[65992]: INFO networking_nsxv3.common.synchronization [req-aa705f36-a9ed-4e02-84a7-d7b454c4762c req-bb8775fd-c356-4693-96b7-f05c67fb6e03 service nova] Enqueued Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGHEST for action security_group_rules [ 700.751367] env[65992]: INFO networking_nsxv3.common.synchronization [req-aa705f36-a9ed-4e02-84a7-d7b454c4762c req-bb8775fd-c356-4693-96b7-f05c67fb6e03 service nova] Enqueued Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGHEST for action security_group_members [ 700.751501] env[65992]: INFO networking_nsxv3.common.synchronization [req-aa705f36-a9ed-4e02-84a7-d7b454c4762c req-bb8775fd-c356-4693-96b7-f05c67fb6e03 service nova] Enqueued Resource ID: 8ece435b-4059-4b6d-8560-25f11d22bcbd with Priority: HIGHEST for action port [ 700.752266] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGHEST for action security_group_rules [ 700.752395] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGHEST for action security_group_members [ 700.752527] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ece435b-4059-4b6d-8560-25f11d22bcbd with Priority: HIGHEST for action port [ 700.752899] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86094f9a-f281-4ae9-afd9-486fd3324728 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.753097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.753189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.753471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.754208] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.755228] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-86094f9a-f281-4ae9-afd9-486fd3324728 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.755462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.755571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.755788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.756591] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.757041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.757198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.757484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.757658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.757843] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.758758] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ece435b-4059-4b6d-8560-25f11d22bcbd taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.758994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ece435b-4059-4b6d-8560-25f11d22bcbd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.759699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ece435b-4059-4b6d-8560-25f11d22bcbd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.759699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ece435b-4059-4b6d-8560-25f11d22bcbd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.759699] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ece435b-4059-4b6d-8560-25f11d22bcbd',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.116344] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 469d7145-af55-48eb-8111-6e095de38d66 in Status: SUCCESS [ 701.116344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.116702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.117534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.117534] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.117676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.117707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.118411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.118706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.119274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.119274] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.261163] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.262669] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-86094f9a-f281-4ae9-afd9-486fd3324728 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.262888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.263470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ece435b-4059-4b6d-8560-25f11d22bcbd with status ACTIVE [ 701.263780] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.263931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.264090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.264578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.265389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.265509] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.265622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.265689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.265868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.265953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.266160] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.266257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.266322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.266723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.266841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.266969] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ece435b-4059-4b6d-8560-25f11d22bcbd is going to be updated. [ 701.295593] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.295840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.295922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.296949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.296949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.296949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ece435b-4059-4b6d-8560-25f11d22bcbd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.407843] env[65992]: INFO networking_nsxv3.common.synchronization [req-cf43cf32-b586-4dd5-8c63-a533e8b419a6 req-bbc534cf-b808-4761-a7a2-9fdede9cd079 tempest-ServersAdminTestJSON-561694848 tempest-ServersAdminTestJSON-561694848-project-member] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 701.408470] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 701.408977] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.408977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.409654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.409896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.410106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.410216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.410296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.410441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.410529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.411415] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.498954] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c05766df-1b14-44a9-aa91-735a92b6816e in Status: SUCCESS [ 701.500076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.622901] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-469d7145-af55-48eb-8111-6e095de38d66 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.623086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.624318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.624318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-469d7145-af55-48eb-8111-6e095de38d66 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.624318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.624693] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.624693] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.624693] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.624693] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.624810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.624857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.624933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.625035] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.764608] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.835334] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-652 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.835550] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.835665] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.837030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.837030] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.837030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.837030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.837030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.837030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.837839] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.837839] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.837839] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.837958] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.838222] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.838307] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.838417] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.861493] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.861669] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.862123] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.862303] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-652" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.862611] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.862780] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.862891] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.863232] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.863377] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.914825] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.128571] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 469d7145-af55-48eb-8111-6e095de38d66: rpc.has_security_group_logging(os_id): False [ 702.151039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.155933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.155933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.155933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.156612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.156612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.156612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.156612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.156612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.156612] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 469d7145-af55-48eb-8111-6e095de38d66 is going to be created. [ 702.213368] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.213540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.213619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.213824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.214013] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.226105] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 469d7145-af55-48eb-8111-6e095de38d66 in Status: IN_PROGRESS for 2s [ 702.267599] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.267818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.267894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.268246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.268246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.268392] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86094f9a-f281-4ae9-afd9-486fd3324728 is going to be created. [ 702.287310] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e3ad6cef-a9e1-480d-b1e0-aa18c8f3b5f2 None None] Enqueued Resource ID: 866d6845-ca01-4cb9-91b8-27d95143641e with Priority: HIGHEST for action port [ 702.287721] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 866d6845-ca01-4cb9-91b8-27d95143641e with Priority: HIGHEST for action port [ 702.289589] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-866d6845-ca01-4cb9-91b8-27d95143641e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.289589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-866d6845-ca01-4cb9-91b8-27d95143641e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.289589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-866d6845-ca01-4cb9-91b8-27d95143641e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.289589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-866d6845-ca01-4cb9-91b8-27d95143641e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.289589] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('866d6845-ca01-4cb9-91b8-27d95143641e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.298880] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.299083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.299083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.299227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.299380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.326401] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86094f9a-f281-4ae9-afd9-486fd3324728 in Status: UNINITIALIZED for 2s [ 702.328794] env[65992]: INFO networking_nsxv3.common.synchronization [None req-b49e2490-d9e6-4abe-8af4-42d8fbd1e6d8 None None] Enqueued Resource ID: 9aed67ba-a925-496b-9dcb-f619732e8af8 with Priority: HIGHEST for action port [ 702.329640] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aed67ba-a925-496b-9dcb-f619732e8af8 with Priority: HIGHEST for action port [ 702.330353] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9aed67ba-a925-496b-9dcb-f619732e8af8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.330883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9aed67ba-a925-496b-9dcb-f619732e8af8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.330883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9aed67ba-a925-496b-9dcb-f619732e8af8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.331053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9aed67ba-a925-496b-9dcb-f619732e8af8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.331157] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aed67ba-a925-496b-9dcb-f619732e8af8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.371073] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.371659] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.371964] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.372744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.373944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.373944] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9 not found, creating... [ 702.373944] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.374178] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.374178] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.374358] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.374439] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.374818] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.377723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.377723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.377924] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.378280] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.378340] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9 is going to be created. [ 702.407963] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.408872] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.409099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.409368] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.409589] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.409833] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.418479] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.792314] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 866d6845-ca01-4cb9-91b8-27d95143641e [ 702.792592] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.792739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.792809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.793041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.793129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.793222] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:866d6845-ca01-4cb9-91b8-27d95143641e already deleted. [ 702.793304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-866d6845-ca01-4cb9-91b8-27d95143641e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.835351] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9aed67ba-a925-496b-9dcb-f619732e8af8 [ 702.835351] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.835351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.835351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.835768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.835983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.836155] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9aed67ba-a925-496b-9dcb-f619732e8af8 already deleted. [ 702.836313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9aed67ba-a925-496b-9dcb-f619732e8af8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.920260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.920405] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.920471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.920678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.920763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.920855] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 702.974054] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.974238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.974288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.974491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.974650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.987447] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 703.179324] env[65992]: INFO networking_nsxv3.common.synchronization [req-cf43cf32-b586-4dd5-8c63-a533e8b419a6 req-98b6fc70-7fee-4edf-96a0-d6e8d82a215b service nova] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_rules [ 703.181026] env[65992]: INFO networking_nsxv3.common.synchronization [req-cf43cf32-b586-4dd5-8c63-a533e8b419a6 req-98b6fc70-7fee-4edf-96a0-d6e8d82a215b service nova] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 703.181026] env[65992]: INFO networking_nsxv3.common.synchronization [req-cf43cf32-b586-4dd5-8c63-a533e8b419a6 req-98b6fc70-7fee-4edf-96a0-d6e8d82a215b service nova] Enqueued Resource ID: 2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9 with Priority: HIGHEST for action port [ 703.181026] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_rules [ 703.181267] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 703.181612] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9 with Priority: HIGHEST for action port [ 703.182033] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.184789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.184789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.184789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.184789] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.184789] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.184789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.184789] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.184789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.184789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.184789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.184789] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.690117] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.690228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.690360] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9 with status ACTIVE [ 703.690501] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.690620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.690671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.691297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.691297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.691297] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.691409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.691409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.691624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.691671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.694387] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.694387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.694387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.694387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.694387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.694387] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9 is going to be updated. [ 703.722572] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.722726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.722796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.723016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.723156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.723630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c2e2e0f-65f0-4746-a9b1-e35f713cf5e9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.241365] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 469d7145-af55-48eb-8111-6e095de38d66 in Status: SUCCESS [ 704.241365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.338251] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86094f9a-f281-4ae9-afd9-486fd3324728 in Status: SUCCESS [ 704.339224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.339224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.339224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.339224] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.339224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.339224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.339521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.339521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.339521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.339610] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.845713] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-86094f9a-f281-4ae9-afd9-486fd3324728 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.846935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.846935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.847131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.847351] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.847490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.847562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.847755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.848631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.848631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.848631] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-86094f9a-f281-4ae9-afd9-486fd3324728 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.848631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.848631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.848631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.848631] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.848882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.848882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.848932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.849164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.849220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.849329] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.000063] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 705.000953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.000953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.000953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.000953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.000953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.001230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.001230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.001230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.001361] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.286746] env[65992]: INFO networking_nsxv3.common.synchronization [None req-17398fbd-bbd8-4b08-8e1c-ecc426c65349 None None] Enqueued Resource ID: ba8fad08-1984-4cd4-a4e2-fae454bc0d75 with Priority: HIGHEST for action port [ 705.287310] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba8fad08-1984-4cd4-a4e2-fae454bc0d75 with Priority: HIGHEST for action port [ 705.287679] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba8fad08-1984-4cd4-a4e2-fae454bc0d75 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.287871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba8fad08-1984-4cd4-a4e2-fae454bc0d75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.287962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba8fad08-1984-4cd4-a4e2-fae454bc0d75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.289182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba8fad08-1984-4cd4-a4e2-fae454bc0d75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.289286] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8fad08-1984-4cd4-a4e2-fae454bc0d75',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.352542] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86094f9a-f281-4ae9-afd9-486fd3324728: rpc.has_security_group_logging(os_id): False [ 705.372450] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.372881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.372970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.373183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.373276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.373505] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.373721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.373721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.373858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.373951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.374370] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.374479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.374694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.374805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.374856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.375117] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.375221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.375283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.375422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.375496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.375581] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86094f9a-f281-4ae9-afd9-486fd3324728 is going to be created. [ 705.439109] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.439266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.439337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.439551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.439856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.462136] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86094f9a-f281-4ae9-afd9-486fd3324728 in Status: IN_PROGRESS for 2s [ 705.508438] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.792392] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba8fad08-1984-4cd4-a4e2-fae454bc0d75 [ 705.792643] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.793349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.793349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.793349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.793349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.793349] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba8fad08-1984-4cd4-a4e2-fae454bc0d75 already deleted. [ 705.793640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba8fad08-1984-4cd4-a4e2-fae454bc0d75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.012335] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.516288] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.516288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.516712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.516712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.516712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.516831] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 706.553646] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.553827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.553880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.554084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.554257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.571938] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 706.641750] env[65992]: INFO networking_nsxv3.common.synchronization [req-4ed5f76a-e431-4c60-9ee9-d4b647a9539a req-fff1db41-f797-4020-af5b-612f545124a8 tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 706.642259] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 706.642580] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.643338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.643338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.643338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.643338] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.643338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.643543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.643581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.643964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.643964] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.047047] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.047422] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.047609] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.047954] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.048278] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.048485] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.048628] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.049047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.049226] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.049495] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.049601] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.050540] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.050719] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.052670] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.052670] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.052670] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.075016] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.075016] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.075016] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.075016] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.075016] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.075016] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.075016] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.075528] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.076351] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec6a5493-f555-4b2c-a42c-6ecfab0a4374',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.149054] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.149228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.149228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.149572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.149572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.150338] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.150514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.150579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.150936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.150936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.150936] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 already deleted. [ 707.151147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.480357] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86094f9a-f281-4ae9-afd9-486fd3324728 in Status: SUCCESS [ 707.480357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.584329] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.584329] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.584329] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.584329] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.584329] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.584329] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port ec6a5493-f555-4b2c-a42c-6ecfab0a4374 not found, creating... [ 707.584329] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.585435] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.585920] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.586715] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.588096] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.588625] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.588945] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.589196] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.589618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.589892] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.591196] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: ec6a5493-f555-4b2c-a42c-6ecfab0a4374 is going to be created. [ 707.615771] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.615771] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.615771] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.616049] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.616417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.616674] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.352467] env[65992]: INFO networking_nsxv3.common.synchronization [req-4ed5f76a-e431-4c60-9ee9-d4b647a9539a req-29043c4e-0d21-4000-9228-af711d770e40 service nova] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_rules [ 708.352607] env[65992]: INFO networking_nsxv3.common.synchronization [req-4ed5f76a-e431-4c60-9ee9-d4b647a9539a req-29043c4e-0d21-4000-9228-af711d770e40 service nova] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 708.353031] env[65992]: INFO networking_nsxv3.common.synchronization [req-4ed5f76a-e431-4c60-9ee9-d4b647a9539a req-29043c4e-0d21-4000-9228-af711d770e40 service nova] Enqueued Resource ID: ec6a5493-f555-4b2c-a42c-6ecfab0a4374 with Priority: HIGHEST for action port [ 708.353427] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_rules [ 708.353649] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 708.353797] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6a5493-f555-4b2c-a42c-6ecfab0a4374 with Priority: HIGHEST for action port [ 708.354161] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.354318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.354422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.354650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.354770] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.355783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.355918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.355991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.356195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.356364] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.356472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.356534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.356714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.356796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.356895] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.359154] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.359154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.359154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.359154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.359154] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec6a5493-f555-4b2c-a42c-6ecfab0a4374',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.565698] env[65992]: INFO networking_nsxv3.common.synchronization [req-3d397843-b37d-46c8-92cb-01b9af822cff req-a83f1526-82cc-49ae-9c60-12813082bad2 tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 708.565909] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 708.566164] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.566297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.566344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.566538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.568719] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.568835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.568910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.569093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.569193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.569276] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.590043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 708.590394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.590674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.591025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.591107] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.591188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.593161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.593702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.593702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.593702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.593702] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.860295] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.860564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.860647] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.861695] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec6a5493-f555-4b2c-a42c-6ecfab0a4374 with status ACTIVE [ 708.861817] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.861929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.862064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.862213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.862304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.862478] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.862598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.862650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.862787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.862906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.863053] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.863150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.863203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.863342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.863414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.863496] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec6a5493-f555-4b2c-a42c-6ecfab0a4374 is going to be updated. [ 708.890917] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.891105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.891145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.891572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.891572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.891692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec6a5493-f555-4b2c-a42c-6ecfab0a4374" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.071267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.071880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.071880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.071880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.071880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.072027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.072091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.072212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.072311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.072404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.072535] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 709.097792] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.097792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.097792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.097792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.097984] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.097984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.097984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.098145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.098203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.098284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.098424] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.098521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.098587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.098744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.098878] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.098966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.100033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.100979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.100979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.100979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.100979] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.109925] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.110143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.110143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.110363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.110515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.124326] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 709.368384] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.490369] env[65992]: INFO networking_nsxv3.common.synchronization [req-5fe3f674-de9d-44df-9a23-5433306175f7 req-553078c0-fdcf-4534-8f88-eabc0a5c14b7 tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 709.490369] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 709.490369] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.490369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.490369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.490369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.490966] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.491229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.491396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.491752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.491954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.492246] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.602033] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8f9dacc-af29-4b40-93c8-17d4f636d125: rpc.has_security_group_logging(os_id): False [ 709.620281] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.620411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.620459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.620998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.620998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.620998] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.621205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.621205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.621292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.622179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.622179] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.622179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.622179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.622179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.622179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.622388] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.622388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.622580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.622705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.622770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.622875] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 709.686089] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.686249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.686303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.686499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.686639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.705163] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 709.870913] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.871079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.871148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.871374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.871461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.871567] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be created. [ 709.882250] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.883196] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.883196] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.883196] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.883299] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.883446] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.883560] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.885121] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.885121] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.885121] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.885121] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.885121] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.885121] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.885121] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.885121] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.885121] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.906231] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.906231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.906231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.906231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.906475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.912195] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.912394] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.912547] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.912791] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.913168] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.913369] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.913491] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.913837] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.913980] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('351b92de-1123-4bc5-9e1b-f1cf23c3ac69',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.920047] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: UNINITIALIZED for 2s [ 709.998037] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.998037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.998037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.998037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.998037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.998037] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.998037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.998037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.998037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.998443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.998443] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a already deleted. [ 709.998443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.422409] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.422409] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.422571] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.422799] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.422944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.423145] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 351b92de-1123-4bc5-9e1b-f1cf23c3ac69 not found, creating... [ 710.423552] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.423828] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.423984] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.424274] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.424421] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.424804] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.424913] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.424993] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.425361] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.425555] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.425726] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 351b92de-1123-4bc5-9e1b-f1cf23c3ac69 is going to be created. [ 710.456077] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.456503] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.456600] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.457037] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.457278] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.457629] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.136259] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 711.136259] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 711.136925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.284703] env[65992]: INFO networking_nsxv3.common.synchronization [req-5fe3f674-de9d-44df-9a23-5433306175f7 req-a18c1860-426d-4425-8f12-5e128e2a263d service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 711.284931] env[65992]: INFO networking_nsxv3.common.synchronization [req-5fe3f674-de9d-44df-9a23-5433306175f7 req-a18c1860-426d-4425-8f12-5e128e2a263d service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 711.285107] env[65992]: INFO networking_nsxv3.common.synchronization [req-5fe3f674-de9d-44df-9a23-5433306175f7 req-a18c1860-426d-4425-8f12-5e128e2a263d service nova] Enqueued Resource ID: 351b92de-1123-4bc5-9e1b-f1cf23c3ac69 with Priority: HIGHEST for action port [ 711.285765] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 711.285913] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 711.286036] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351b92de-1123-4bc5-9e1b-f1cf23c3ac69 with Priority: HIGHEST for action port [ 711.286841] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.286841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.286841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.287031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.287031] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.287835] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.287948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.288023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.288247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.288524] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.288613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.288613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.288752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.288839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.288954] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.290142] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.291390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.291390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.291390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.291390] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('351b92de-1123-4bc5-9e1b-f1cf23c3ac69',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.724955] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 711.725568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.793572] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.793572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.793572] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.796602] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 351b92de-1123-4bc5-9e1b-f1cf23c3ac69 with status ACTIVE [ 711.796821] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.796934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.796999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.797225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.797305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.797479] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.798409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.798540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.798662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.798757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.798954] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.799065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.799137] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.799263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.799332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.800762] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 351b92de-1123-4bc5-9e1b-f1cf23c3ac69 is going to be updated. [ 711.828788] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.828928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.830455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.830948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.830948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.831169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-351b92de-1123-4bc5-9e1b-f1cf23c3ac69" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.933469] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 711.933469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.933469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.933469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.933469] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.933469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.933469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.933469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.933469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.933469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.933469] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.296165] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.437916] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.800349] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.800545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.800652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.800940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.801096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.801185] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be created. [ 712.829482] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.829482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.829482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.829743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.829909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.845833] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: UNINITIALIZED for 2s [ 712.941624] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58a9088b-471e-48ab-8bf1-877d11c93872: rpc.has_security_group_logging(os_id): False [ 712.970113] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.970317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.970416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.970722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.970890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.971286] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.971541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.971541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.971713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.971798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.971960] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be created. [ 713.045933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.046124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.046211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.046427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.046615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.075083] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: IN_PROGRESS for 2s [ 714.863328] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 714.863328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.863328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.863328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.863328] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.863328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.863328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.863328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.863328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.863328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.863328] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.100073] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 715.100073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.117369] env[65992]: INFO networking_nsxv3.common.synchronization [req-d0b6e568-a4aa-4a97-808f-047481c42399 req-36d4168e-526c-4285-84a7-080c9fd3cb6e tempest-InstanceActionsV221TestJSON-1390411719 tempest-InstanceActionsV221TestJSON-1390411719-project-member] Enqueued Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGHEST for action security_group_members [ 715.118370] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGHEST for action security_group_members [ 715.119284] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0ad3c9-7e54-40f4-a88a-89bc030489f8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.119993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.120209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.120631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.121023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.121322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.121322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.121595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.121785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.121994] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.370869] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.370869] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.370869] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.370869] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.370869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.371819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.371819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.371819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.371819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.373063] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.625221] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.625531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.625657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.626010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.626142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.626570] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.626570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.626570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.626685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.626751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.626947] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 already deleted. [ 715.627047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.876274] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 246ce419-a7b7-4e23-8bd8-c4c071ac447a: rpc.has_security_group_logging(os_id): False [ 715.896411] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.896557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.896633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.896853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.896943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.897167] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.897267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.897344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.897691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.897691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.897873] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.897941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.897999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.898193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.898238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.898411] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.898564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.898564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.898781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.898781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.898864] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be created. [ 715.910217] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-870 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.910415] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-870" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.910532] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-870" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.910858] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-870" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.911129] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.911285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.911441] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.911591] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.911726] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.911928] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.912041] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.914126] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.914300] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.914459] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.914589] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.914753] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.940734] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.940787] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.940938] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.941176] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-870" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.941581] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-687397ef-ca49-4d24-bcd3-7a565ce4d444 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.941862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-687397ef-ca49-4d24-bcd3-7a565ce4d444" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.941958] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-687397ef-ca49-4d24-bcd3-7a565ce4d444" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.942491] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-687397ef-ca49-4d24-bcd3-7a565ce4d444" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.942673] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('687397ef-ca49-4d24-bcd3-7a565ce4d444',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.969726] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.970018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.970018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.970267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.970473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.987454] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 716.446773] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.447012] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.447151] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.447902] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.447902] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.447902] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 687397ef-ca49-4d24-bcd3-7a565ce4d444 not found, creating... [ 716.448132] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.448337] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.448467] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.448736] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.448924] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.449279] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.449495] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.449629] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.449900] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.450073] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.450241] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 687397ef-ca49-4d24-bcd3-7a565ce4d444 is going to be created. [ 716.480905] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.480905] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.480905] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.481184] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.482030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.482030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-687397ef-ca49-4d24-bcd3-7a565ce4d444" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.262036] env[65992]: INFO networking_nsxv3.common.synchronization [req-d0b6e568-a4aa-4a97-808f-047481c42399 req-0e5b67bf-1970-43c3-8bbc-60fe7507599e service nova] Enqueued Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGHEST for action security_group_rules [ 717.264343] env[65992]: INFO networking_nsxv3.common.synchronization [req-d0b6e568-a4aa-4a97-808f-047481c42399 req-0e5b67bf-1970-43c3-8bbc-60fe7507599e service nova] Enqueued Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGHEST for action security_group_members [ 717.268656] env[65992]: INFO networking_nsxv3.common.synchronization [req-d0b6e568-a4aa-4a97-808f-047481c42399 req-0e5b67bf-1970-43c3-8bbc-60fe7507599e service nova] Enqueued Resource ID: 687397ef-ca49-4d24-bcd3-7a565ce4d444 with Priority: HIGHEST for action port [ 717.268656] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGHEST for action security_group_rules [ 717.268656] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGHEST for action security_group_members [ 717.268656] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687397ef-ca49-4d24-bcd3-7a565ce4d444 with Priority: HIGHEST for action port [ 717.268656] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.268656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.268656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.268656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.268656] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.271296] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0ad3c9-7e54-40f4-a88a-89bc030489f8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.271296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.271296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.271296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.271296] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.271296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.271296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.271913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.271913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.271913] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.272994] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-687397ef-ca49-4d24-bcd3-7a565ce4d444 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.272994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-687397ef-ca49-4d24-bcd3-7a565ce4d444" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.273152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-687397ef-ca49-4d24-bcd3-7a565ce4d444" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.273253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-687397ef-ca49-4d24-bcd3-7a565ce4d444" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.274080] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('687397ef-ca49-4d24-bcd3-7a565ce4d444',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.275611] env[65992]: INFO networking_nsxv3.common.synchronization [None req-191cf257-fda3-4b0a-8f54-31f96b529a4d None None] Enqueued Resource ID: aa7ca95b-0ab6-481b-bee5-079777853285 with Priority: HIGHEST for action port [ 717.276021] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7ca95b-0ab6-481b-bee5-079777853285 with Priority: HIGHEST for action port [ 717.277031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa7ca95b-0ab6-481b-bee5-079777853285 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.277170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa7ca95b-0ab6-481b-bee5-079777853285" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.277260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa7ca95b-0ab6-481b-bee5-079777853285" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.277460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa7ca95b-0ab6-481b-bee5-079777853285" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.277622] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa7ca95b-0ab6-481b-bee5-079777853285',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.771160] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0ad3c9-7e54-40f4-a88a-89bc030489f8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.771160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.778046] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.778046] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 687397ef-ca49-4d24-bcd3-7a565ce4d444 with status ACTIVE [ 717.778046] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.778046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.778046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.778046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.778046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.778046] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.778046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.778046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.778046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.778046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.778046] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.782067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.782359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.782734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.782919] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.783138] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 687397ef-ca49-4d24-bcd3-7a565ce4d444 is going to be updated. [ 717.784877] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa7ca95b-0ab6-481b-bee5-079777853285 [ 717.786626] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.786903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.787071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.787343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.787537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.787737] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa7ca95b-0ab6-481b-bee5-079777853285 already deleted. [ 717.787915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa7ca95b-0ab6-481b-bee5-079777853285" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.814454] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.814648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.814704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.815383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.815383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.815383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-687397ef-ca49-4d24-bcd3-7a565ce4d444" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.009671] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 718.010047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.289104] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.789491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.790693] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.790864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.791266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.792038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.792185] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 is going to be created. [ 718.823416] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.823607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.823640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.824704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.824704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.838557] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 in Status: UNINITIALIZED for 2s [ 719.413243] env[65992]: INFO networking_nsxv3.common.synchronization [None req-601ed094-1488-46ff-b371-f2309ffd371b None None] Enqueued Resource ID: 2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7 with Priority: HIGHEST for action port [ 719.413243] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7 with Priority: HIGHEST for action port [ 719.413735] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.413982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.414156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.414468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.414738] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.920274] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7 [ 719.920274] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.920274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.920274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.920274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.920274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.920274] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7 already deleted. [ 719.920274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eff86c0-e6ab-444a-bd96-bc5a2eba5cb7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.033806] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e90ff9ed-0ffc-4ded-8603-6ecdc44a794f None None] Enqueued Resource ID: c5747ca0-48c3-4eac-80d0-dcb58ccd261e with Priority: HIGHEST for action port [ 720.035593] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5747ca0-48c3-4eac-80d0-dcb58ccd261e with Priority: HIGHEST for action port [ 720.035593] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5747ca0-48c3-4eac-80d0-dcb58ccd261e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.035593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5747ca0-48c3-4eac-80d0-dcb58ccd261e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.035593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5747ca0-48c3-4eac-80d0-dcb58ccd261e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.035593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5747ca0-48c3-4eac-80d0-dcb58ccd261e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.035593] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5747ca0-48c3-4eac-80d0-dcb58ccd261e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.468029] env[65992]: INFO networking_nsxv3.common.synchronization [None req-3963580c-6672-4dd8-9427-4a50436e1cad None None] Enqueued Resource ID: 35aae4ad-986f-444f-a9c7-52be28d595ba with Priority: HIGHEST for action port [ 720.468029] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35aae4ad-986f-444f-a9c7-52be28d595ba with Priority: HIGHEST for action port [ 720.468795] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-35aae4ad-986f-444f-a9c7-52be28d595ba taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.470739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35aae4ad-986f-444f-a9c7-52be28d595ba" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.470739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35aae4ad-986f-444f-a9c7-52be28d595ba" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.470739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35aae4ad-986f-444f-a9c7-52be28d595ba" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.470739] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35aae4ad-986f-444f-a9c7-52be28d595ba',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.540609] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5747ca0-48c3-4eac-80d0-dcb58ccd261e [ 720.540842] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.540986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.541108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.542079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.542079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.542079] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5747ca0-48c3-4eac-80d0-dcb58ccd261e already deleted. [ 720.542079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5747ca0-48c3-4eac-80d0-dcb58ccd261e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.855213] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 in Status: SUCCESS [ 720.855213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.855213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.855213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.855213] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.855213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.855213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.855213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.855213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.855213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.855213] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.973674] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35aae4ad-986f-444f-a9c7-52be28d595ba [ 720.974100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.974385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.974575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.974861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.975315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.975521] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35aae4ad-986f-444f-a9c7-52be28d595ba already deleted. [ 720.975889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35aae4ad-986f-444f-a9c7-52be28d595ba" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.357123] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0ad3c9-7e54-40f4-a88a-89bc030489f8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.357332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.357454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.357656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.357874] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.357986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.358062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.358239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.358325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.358461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.358639] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0ad3c9-7e54-40f4-a88a-89bc030489f8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.358743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.358802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.358947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.359168] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.359268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.359326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.359468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.359560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.360651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.360651] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.864384] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df0ad3c9-7e54-40f4-a88a-89bc030489f8: rpc.has_security_group_logging(os_id): False [ 721.886628] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.886856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.886931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.887182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.887279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.888402] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.888402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.888402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.888402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.888402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.888402] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.888402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.888703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.888703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.888758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.888958] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.891837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.892014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.892251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.892416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.892579] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 is going to be created. [ 721.898366] env[65992]: INFO networking_nsxv3.common.synchronization [None req-ff129074-a4f6-4618-b5fc-d4b6379707d0 None None] Enqueued Resource ID: 9464ca73-89ef-4910-bda0-84c062ed9397 with Priority: HIGHEST for action port [ 721.898366] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9464ca73-89ef-4910-bda0-84c062ed9397 with Priority: HIGHEST for action port [ 721.898707] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9464ca73-89ef-4910-bda0-84c062ed9397 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.898811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9464ca73-89ef-4910-bda0-84c062ed9397" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.898849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9464ca73-89ef-4910-bda0-84c062ed9397" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.899786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9464ca73-89ef-4910-bda0-84c062ed9397" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.899786] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9464ca73-89ef-4910-bda0-84c062ed9397',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.967556] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.967556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.967720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.968033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.968236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.988153] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 in Status: IN_PROGRESS for 2s [ 721.997856] env[65992]: INFO networking_nsxv3.common.synchronization [req-7fe792e8-07da-4ca8-8537-29b544007d67 req-409a75a8-2812-4e2b-a1eb-fd617e8e3fac tempest-ServersTestFqdnHostnames-1006644802 tempest-ServersTestFqdnHostnames-1006644802-project-member] Enqueued Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_members [ 721.998506] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_members [ 721.999023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.003522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.003677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.004979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.004979] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.004979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.004979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.004979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.004979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.004979] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.344110] env[65992]: INFO networking_nsxv3.common.synchronization [None req-2cedcfe5-4fb1-4728-8aa8-96dcc55f52d0 None None] Enqueued Resource ID: 6cc59436-44df-4214-80df-9b73a4771ebf with Priority: HIGHEST for action port [ 722.344110] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cc59436-44df-4214-80df-9b73a4771ebf with Priority: HIGHEST for action port [ 722.347797] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cc59436-44df-4214-80df-9b73a4771ebf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.347797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cc59436-44df-4214-80df-9b73a4771ebf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.347797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cc59436-44df-4214-80df-9b73a4771ebf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.347797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cc59436-44df-4214-80df-9b73a4771ebf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.347797] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cc59436-44df-4214-80df-9b73a4771ebf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.402300] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9464ca73-89ef-4910-bda0-84c062ed9397 [ 722.402494] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.402634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.402706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.402949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.403054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.403161] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9464ca73-89ef-4910-bda0-84c062ed9397 already deleted. [ 722.403245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9464ca73-89ef-4910-bda0-84c062ed9397" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.508172] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.508172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.508172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.508626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.508728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.508936] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.509064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.509130] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.509318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.509394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.509452] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce already deleted. [ 722.509542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.728273] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-71 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.728273] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-71" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.728273] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-71" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.728273] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-71" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.728273] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.728941] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.729173] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.729471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.729671] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.730436] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.730436] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.730436] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.730436] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.730436] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.730643] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.730693] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.752405] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.752554] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.752880] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.752880] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-71" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.754125] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-bafba534-a0db-4880-b146-e50b61db367d taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.754125] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-bafba534-a0db-4880-b146-e50b61db367d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.754125] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-bafba534-a0db-4880-b146-e50b61db367d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.754125] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-bafba534-a0db-4880-b146-e50b61db367d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.754125] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bafba534-a0db-4880-b146-e50b61db367d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.852886] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cc59436-44df-4214-80df-9b73a4771ebf [ 722.852886] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.852886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.852886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.852886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.852886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.852886] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cc59436-44df-4214-80df-9b73a4771ebf already deleted. [ 722.852886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cc59436-44df-4214-80df-9b73a4771ebf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.257146] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.257602] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.257736] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.258022] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.258176] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.258358] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port bafba534-a0db-4880-b146-e50b61db367d not found, creating... [ 723.258641] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.258864] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.258912] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.259166] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.259299] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.259579] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.259729] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.259839] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.260133] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.260296] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.260442] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: bafba534-a0db-4880-b146-e50b61db367d is going to be created. [ 723.272768] env[65992]: INFO networking_nsxv3.common.synchronization [None req-2ade9e92-5e69-4ee6-b002-616926e8f0b7 None None] Enqueued Resource ID: 735ecbd6-0047-4130-a542-6604a0285768 with Priority: HIGHEST for action port [ 723.273402] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735ecbd6-0047-4130-a542-6604a0285768 with Priority: HIGHEST for action port [ 723.273726] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-735ecbd6-0047-4130-a542-6604a0285768 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.273855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-735ecbd6-0047-4130-a542-6604a0285768" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.273946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-735ecbd6-0047-4130-a542-6604a0285768" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.274639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-735ecbd6-0047-4130-a542-6604a0285768" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.274739] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('735ecbd6-0047-4130-a542-6604a0285768',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.288021] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.288021] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.288021] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.288021] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.288021] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.288021] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-bafba534-a0db-4880-b146-e50b61db367d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.581851] env[65992]: INFO networking_nsxv3.common.synchronization [req-ebb8cde3-26bb-4d9f-a1e1-830041b08773 req-14b192bb-c85d-4598-a934-b13a36ced97c tempest-InstanceActionsTestJSON-55783644 tempest-InstanceActionsTestJSON-55783644-project-member] Enqueued Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGHEST for action security_group_members [ 723.582503] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGHEST for action security_group_members [ 723.582789] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c05766df-1b14-44a9-aa91-735a92b6816e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.582925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.582993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.583221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.583389] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.583495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.583555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.583796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.583796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.583883] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.777347] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 735ecbd6-0047-4130-a542-6604a0285768 [ 723.779322] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.779322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.779322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.779322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.779322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.779322] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:735ecbd6-0047-4130-a542-6604a0285768 already deleted. [ 723.779322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-735ecbd6-0047-4130-a542-6604a0285768" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.005425] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 in Status: SUCCESS [ 724.005719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.076521] env[65992]: INFO networking_nsxv3.common.synchronization [req-7fe792e8-07da-4ca8-8537-29b544007d67 req-328041d6-531c-4a43-afd6-fc0ac30ed200 service nova] Enqueued Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_rules [ 724.076937] env[65992]: INFO networking_nsxv3.common.synchronization [req-7fe792e8-07da-4ca8-8537-29b544007d67 req-328041d6-531c-4a43-afd6-fc0ac30ed200 service nova] Enqueued Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_members [ 724.077241] env[65992]: INFO networking_nsxv3.common.synchronization [req-7fe792e8-07da-4ca8-8537-29b544007d67 req-328041d6-531c-4a43-afd6-fc0ac30ed200 service nova] Enqueued Resource ID: bafba534-a0db-4880-b146-e50b61db367d with Priority: HIGHEST for action port [ 724.078124] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_rules [ 724.078394] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_members [ 724.078695] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bafba534-a0db-4880-b146-e50b61db367d with Priority: HIGHEST for action port [ 724.079112] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.079325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.079472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.079798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.079979] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.081818] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.082066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.082227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.083096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.083410] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.084052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.084052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.084052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.084550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.084550] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.088025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bafba534-a0db-4880-b146-e50b61db367d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.088025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bafba534-a0db-4880-b146-e50b61db367d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.088025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bafba534-a0db-4880-b146-e50b61db367d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.088025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bafba534-a0db-4880-b146-e50b61db367d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.088025] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bafba534-a0db-4880-b146-e50b61db367d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.092167] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.092167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.092167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.092167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.092167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.092167] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.092167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.092819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.093089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.093232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.093387] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05766df-1b14-44a9-aa91-735a92b6816e is going to be updated. [ 724.154803] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.155019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.155098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.155339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.155514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.166795] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05766df-1b14-44a9-aa91-735a92b6816e in Status: IN_PROGRESS for 2s [ 724.458657] env[65992]: INFO networking_nsxv3.common.synchronization [None req-4225df72-a0a4-4677-9258-db8297d21e55 None None] Enqueued Resource ID: bf0f1d6a-70ee-4eb2-8224-28214a6151ef with Priority: HIGHEST for action port [ 724.458978] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf0f1d6a-70ee-4eb2-8224-28214a6151ef with Priority: HIGHEST for action port [ 724.459235] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf0f1d6a-70ee-4eb2-8224-28214a6151ef taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.459369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf0f1d6a-70ee-4eb2-8224-28214a6151ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.459438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf0f1d6a-70ee-4eb2-8224-28214a6151ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.459692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf0f1d6a-70ee-4eb2-8224-28214a6151ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.459775] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0f1d6a-70ee-4eb2-8224-28214a6151ef',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.554959] env[65992]: INFO networking_nsxv3.common.synchronization [req-deac2e09-1b3a-474d-a446-b8a81b37be67 req-be3819e0-2272-47ec-aca8-7a9837b192cf tempest-ServersWithSpecificFlavorTestJSON-1648883113 tempest-ServersWithSpecificFlavorTestJSON-1648883113-project-member] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 724.555719] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 724.556658] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.557018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.557018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.558383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.558807] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.558807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.558807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.558979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.559029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.559136] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.588042] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.591344] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bafba534-a0db-4880-b146-e50b61db367d with status ACTIVE [ 724.592708] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.592708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.592708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.592870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.592870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.593040] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.593140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.593197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.593350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.593430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.593605] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.593690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.593747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.594050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.594163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.594276] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bafba534-a0db-4880-b146-e50b61db367d is going to be updated. [ 724.595676] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.595988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.619538] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.619538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.619538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.619538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.619538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.619538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bafba534-a0db-4880-b146-e50b61db367d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.962211] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf0f1d6a-70ee-4eb2-8224-28214a6151ef [ 724.962441] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.962579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.962646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.962855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.962935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.963035] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf0f1d6a-70ee-4eb2-8224-28214a6151ef already deleted. [ 724.963114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf0f1d6a-70ee-4eb2-8224-28214a6151ef" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.974612] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.974767] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-35" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.974834] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-35" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.975103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-35" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.975859] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.975859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.975859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.975859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.976052] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.976451] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.976557] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.976667] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.976790] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.976899] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.976994] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.977136] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.003042] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.003304] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.003397] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.003561] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-35" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.003896] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-43b5d351-f068-4b72-b791-5d7135933dec taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.004512] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-43b5d351-f068-4b72-b791-5d7135933dec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.004512] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-43b5d351-f068-4b72-b791-5d7135933dec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.004623] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-43b5d351-f068-4b72-b791-5d7135933dec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.004687] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b5d351-f068-4b72-b791-5d7135933dec',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.062985] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.063172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.063245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.063457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.063549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.063741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.063841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.063905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.064069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.064145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.064232] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be updated. [ 725.091510] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.100954] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.100954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.101090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.101276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.101441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.112693] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: IN_PROGRESS for 2s [ 725.507369] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.507878] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.507878] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.508071] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.508216] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.508368] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 43b5d351-f068-4b72-b791-5d7135933dec not found, creating... [ 725.508652] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.508826] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.508905] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.509153] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.509294] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.509582] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.509740] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.509861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.510333] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.510508] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.510679] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 43b5d351-f068-4b72-b791-5d7135933dec is going to be created. [ 725.537802] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.538152] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.538434] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.538798] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.539047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.539289] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-43b5d351-f068-4b72-b791-5d7135933dec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.596070] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.596572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.596759] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.597087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.597233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.597381] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce is going to be created. [ 725.632690] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.632839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.632909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.633233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.633313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.663985] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce in Status: UNINITIALIZED for 2s [ 726.178570] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c05766df-1b14-44a9-aa91-735a92b6816e in Status: SUCCESS [ 726.178570] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c05766df-1b14-44a9-aa91-735a92b6816e deletion is rescheduled due to dependency. [ 726.178570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.253754] env[65992]: INFO networking_nsxv3.common.synchronization [None req-5d10b0ea-2163-4c1d-bc1c-bf2aea7bbea9 tempest-ServerActionsV293TestJSON-1691925799 tempest-ServerActionsV293TestJSON-1691925799-project-member] Enqueued Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_rules [ 726.253754] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_rules [ 726.253754] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.253754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.254114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.255247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.255585] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.322868] env[65992]: INFO networking_nsxv3.common.synchronization [req-deac2e09-1b3a-474d-a446-b8a81b37be67 req-e4bf9cf0-9faf-4546-98a1-fc13a6a62844 service nova] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_rules [ 726.323247] env[65992]: INFO networking_nsxv3.common.synchronization [req-deac2e09-1b3a-474d-a446-b8a81b37be67 req-e4bf9cf0-9faf-4546-98a1-fc13a6a62844 service nova] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 726.323343] env[65992]: INFO networking_nsxv3.common.synchronization [req-deac2e09-1b3a-474d-a446-b8a81b37be67 req-e4bf9cf0-9faf-4546-98a1-fc13a6a62844 service nova] Enqueued Resource ID: 43b5d351-f068-4b72-b791-5d7135933dec with Priority: HIGHEST for action port [ 726.323800] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_rules [ 726.323934] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 726.324095] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43b5d351-f068-4b72-b791-5d7135933dec with Priority: HIGHEST for action port [ 726.324359] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.324483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.324542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.324741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.324823] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.325906] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.325906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.326094] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-43b5d351-f068-4b72-b791-5d7135933dec taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.326094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43b5d351-f068-4b72-b791-5d7135933dec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.326229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43b5d351-f068-4b72-b791-5d7135933dec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.326492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43b5d351-f068-4b72-b791-5d7135933dec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.326590] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43b5d351-f068-4b72-b791-5d7135933dec',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.469524] env[65992]: INFO networking_nsxv3.common.synchronization [None req-36699393-75ca-43db-8531-dcc2473ae081 tempest-ServerActionsV293TestJSON-1691925799 tempest-ServerActionsV293TestJSON-1691925799-project-member] Enqueued Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_rules [ 726.469722] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_rules [ 726.470036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.470199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.599336] env[65992]: INFO networking_nsxv3.common.synchronization [None req-25b4fe32-ee1f-497b-90bc-87cf4b622620 None None] Enqueued Resource ID: bab49725-0e7d-44cb-a78b-cd42dac578df with Priority: HIGHEST for action port [ 726.600571] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab49725-0e7d-44cb-a78b-cd42dac578df with Priority: HIGHEST for action port [ 726.600974] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bab49725-0e7d-44cb-a78b-cd42dac578df taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.601152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bab49725-0e7d-44cb-a78b-cd42dac578df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.601593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bab49725-0e7d-44cb-a78b-cd42dac578df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.601593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bab49725-0e7d-44cb-a78b-cd42dac578df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.601593] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bab49725-0e7d-44cb-a78b-cd42dac578df',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.781070] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.781333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.781333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.781498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.781596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.781667] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 already deleted. [ 726.781781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.781999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.782176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.782254] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.832024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.832024] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43b5d351-f068-4b72-b791-5d7135933dec with status ACTIVE [ 726.832024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.832024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.832024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.832024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.833566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.833566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.833566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.833566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.833566] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43b5d351-f068-4b72-b791-5d7135933dec is going to be updated. [ 726.858118] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.858118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.858118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.858118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.858118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.858118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43b5d351-f068-4b72-b791-5d7135933dec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.107110] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bab49725-0e7d-44cb-a78b-cd42dac578df [ 727.107110] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.107110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.107110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.107110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.107110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.107110] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bab49725-0e7d-44cb-a78b-cd42dac578df already deleted. [ 727.107110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bab49725-0e7d-44cb-a78b-cd42dac578df" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.129716] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: SUCCESS [ 727.129716] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 deletion is rescheduled due to dependency. [ 727.129716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.129716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.129716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.129716] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.129716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.129716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.129716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.129716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.129716] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.312158] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.312357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.312457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.312789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.317022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.317022] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 already deleted. [ 727.317022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.384178] env[65992]: INFO networking_nsxv3.common.synchronization [req-c33b6ab1-7013-4be0-914d-4caf3c0df2ce req-fe425a0e-6966-4044-99f6-be4693b58a07 tempest-TenantUsagesTestJSON-812525012 tempest-TenantUsagesTestJSON-812525012-project-member] Enqueued Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGHEST for action security_group_members [ 727.385031] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGHEST for action security_group_members [ 727.385155] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-86094f9a-f281-4ae9-afd9-486fd3324728 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.385222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.385257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.385451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.385633] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.385761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.385816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.385938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.388171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.388171] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.632149] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.680073] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce in Status: SUCCESS [ 727.680409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.681038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.681790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.681790] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.681790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.682178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.682178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.682178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.682276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.682410] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.892144] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.892144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.892144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.892144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.892144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.892144] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.892144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.892144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.892144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.892144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.892144] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86094f9a-f281-4ae9-afd9-486fd3324728 is going to be updated. [ 727.925259] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.925259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.925259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.925259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.925259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.934551] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86094f9a-f281-4ae9-afd9-486fd3324728 in Status: IN_PROGRESS for 2s [ 728.138115] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.185186] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.640212] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.640533] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.640533] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.640605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.640693] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.640823] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be updated. [ 728.678130] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.678770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.678770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.678770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.679989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.689215] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58879f8e-8e07-40c8-a0c9-63ab056f38ce: rpc.has_security_group_logging(os_id): False [ 728.692316] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: IN_PROGRESS for 2s [ 728.720901] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.721175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.721306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.721628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.721779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.722226] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.722994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.722994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.722994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.722994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.722994] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce is going to be created. [ 728.727804] env[65992]: INFO networking_nsxv3.common.synchronization [req-7fbfd0a8-82f8-444e-856c-fdd55ba0f8c7 req-7a84dbcf-d895-4d95-a258-338eb4d95896 tempest-SecurityGroupRulesTestJSON-844375077 tempest-SecurityGroupRulesTestJSON-844375077-project-member] Enqueued Resource ID: 228ff16f-dbf8-4278-bd68-ae0404ed8921 with Priority: HIGHEST for action security_group_rules [ 728.728642] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 228ff16f-dbf8-4278-bd68-ae0404ed8921 with Priority: HIGHEST for action security_group_rules [ 728.729189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-228ff16f-dbf8-4278-bd68-ae0404ed8921 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.729368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-228ff16f-dbf8-4278-bd68-ae0404ed8921" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.729470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-228ff16f-dbf8-4278-bd68-ae0404ed8921" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.729819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-228ff16f-dbf8-4278-bd68-ae0404ed8921" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.729943] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('228ff16f-dbf8-4278-bd68-ae0404ed8921',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.798109] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.798359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.798484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.798782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.798977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.815699] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce in Status: IN_PROGRESS for 2s [ 729.256751] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.256914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.256985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.257220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.257313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.257439] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 228ff16f-dbf8-4278-bd68-ae0404ed8921 already deleted. [ 729.257492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-228ff16f-dbf8-4278-bd68-ae0404ed8921" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.595110] env[65992]: INFO networking_nsxv3.common.synchronization [req-d2a084a4-655c-40cb-914b-b175b8b8f19a req-653c6d40-5ffc-415e-8fec-3844de2b5f15 tempest-ServerMetadataTestJSON-592403218 tempest-ServerMetadataTestJSON-592403218-project-member] Enqueued Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGHEST for action security_group_members [ 729.595110] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGHEST for action security_group_members [ 729.595110] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4846c43f-6807-48c3-8d2a-ba94d8295f7f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.595110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.595110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.595110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.595110] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.595110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.595110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.596783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.596956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.597173] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.653198] env[65992]: INFO networking_nsxv3.common.synchronization [None req-20d082e9-1a62-47e2-9b5b-63f3c2de5b14 None None] Enqueued Resource ID: 96526f0d-d1a8-4996-ada6-fac0c6951230 with Priority: HIGHEST for action port [ 729.653737] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96526f0d-d1a8-4996-ada6-fac0c6951230 with Priority: HIGHEST for action port [ 729.654043] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-96526f0d-d1a8-4996-ada6-fac0c6951230 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.654213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96526f0d-d1a8-4996-ada6-fac0c6951230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.654337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96526f0d-d1a8-4996-ada6-fac0c6951230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.654652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96526f0d-d1a8-4996-ada6-fac0c6951230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.654750] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96526f0d-d1a8-4996-ada6-fac0c6951230',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.948490] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86094f9a-f281-4ae9-afd9-486fd3324728 in Status: SUCCESS [ 729.948490] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86094f9a-f281-4ae9-afd9-486fd3324728 deletion is rescheduled due to dependency. [ 729.948490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.099263] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.099422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.099535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.099699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.099792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.100016] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.100083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.100144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.100287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.100400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.100436] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f already deleted. [ 730.100503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.157707] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96526f0d-d1a8-4996-ada6-fac0c6951230 [ 730.157707] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.157707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.157707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.157707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.157707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.157707] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96526f0d-d1a8-4996-ada6-fac0c6951230 already deleted. [ 730.157707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96526f0d-d1a8-4996-ada6-fac0c6951230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.181116] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.181372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-296" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.181541] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-296" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.182189] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-296" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.184999] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.184999] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.184999] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.184999] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.184999] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.185323] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.185323] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.185393] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.185520] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.186462] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.186631] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.186787] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.207100] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.207298] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.207463] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.207603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-296" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.207998] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-c8558216-5c02-47dd-8c4a-24eed349fa75 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.208187] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-c8558216-5c02-47dd-8c4a-24eed349fa75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.208330] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-c8558216-5c02-47dd-8c4a-24eed349fa75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.208655] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-c8558216-5c02-47dd-8c4a-24eed349fa75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.208812] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8558216-5c02-47dd-8c4a-24eed349fa75',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.707445] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: SUCCESS [ 730.707854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.708089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.708360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.708605] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.708895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.708994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.711771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.711901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.711976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.712064] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.713382] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.713579] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.713679] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.714218] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.714218] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.714218] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port c8558216-5c02-47dd-8c4a-24eed349fa75 not found, creating... [ 730.714486] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.714628] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.714780] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.714780] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.720320] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.721030] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.721360] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.721603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.722052] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.722295] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.722542] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: c8558216-5c02-47dd-8c4a-24eed349fa75 is going to be created. [ 730.753805] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.753805] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.753805] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.753805] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.753805] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.754129] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-c8558216-5c02-47dd-8c4a-24eed349fa75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.829457] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce in Status: SUCCESS [ 730.829768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.226396] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.495015] env[65992]: INFO networking_nsxv3.common.synchronization [req-d2a084a4-655c-40cb-914b-b175b8b8f19a req-ef7706d4-8705-426b-ba1b-e875fa29fcdc service nova] Enqueued Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGHEST for action security_group_rules [ 731.495015] env[65992]: INFO networking_nsxv3.common.synchronization [req-d2a084a4-655c-40cb-914b-b175b8b8f19a req-ef7706d4-8705-426b-ba1b-e875fa29fcdc service nova] Enqueued Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGHEST for action security_group_members [ 731.495015] env[65992]: INFO networking_nsxv3.common.synchronization [req-d2a084a4-655c-40cb-914b-b175b8b8f19a req-ef7706d4-8705-426b-ba1b-e875fa29fcdc service nova] Enqueued Resource ID: c8558216-5c02-47dd-8c4a-24eed349fa75 with Priority: HIGHEST for action port [ 731.495015] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGHEST for action security_group_rules [ 731.495015] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGHEST for action security_group_members [ 731.495015] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8558216-5c02-47dd-8c4a-24eed349fa75 with Priority: HIGHEST for action port [ 731.498549] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.500100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.500260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.500574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.500661] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.501696] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4846c43f-6807-48c3-8d2a-ba94d8295f7f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.505291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.505408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.505590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.505816] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.505942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.506042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.506252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.506375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.506524] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.508264] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8558216-5c02-47dd-8c4a-24eed349fa75 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.508442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8558216-5c02-47dd-8c4a-24eed349fa75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.508543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8558216-5c02-47dd-8c4a-24eed349fa75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.508821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8558216-5c02-47dd-8c4a-24eed349fa75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.508940] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8558216-5c02-47dd-8c4a-24eed349fa75',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.729137] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b1651ec-9ca7-4bf6-866b-28fade5b94c5: rpc.has_security_group_logging(os_id): False [ 731.751145] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.751311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.751381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.751663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.751757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.752013] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.752330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.752410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.752602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.752697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.752827] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be updated. [ 731.840154] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.840376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.840376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.840584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.840737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.856922] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: IN_PROGRESS for 2s [ 732.015324] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4846c43f-6807-48c3-8d2a-ba94d8295f7f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.015753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.015883] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.017087] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8558216-5c02-47dd-8c4a-24eed349fa75 with status ACTIVE [ 732.017341] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.017685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.017685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.017878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.017985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.018702] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.018702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.018965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.019263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.019427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.019841] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.020087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.020248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.020535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.020699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.020860] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8558216-5c02-47dd-8c4a-24eed349fa75 is going to be updated. [ 732.047572] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.047817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.047939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.048227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.048367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.048533] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8558216-5c02-47dd-8c4a-24eed349fa75" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.453211] env[65992]: INFO networking_nsxv3.common.synchronization [req-a7024261-be9b-41eb-b83d-57b23b27838a req-b099f979-c34e-42d7-820d-6fa224eda9a6 tempest-ImagesNegativeTestJSON-405197654 tempest-ImagesNegativeTestJSON-405197654-project-member] Enqueued Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGHEST for action security_group_members [ 732.455392] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGHEST for action security_group_members [ 732.455392] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffb03a45-85bd-476b-b6c0-c61a67ecca90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.455392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.455392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.455392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.455392] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.455392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.455392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.455392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.455392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.455937] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.523444] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.898627] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.899054] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-281" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.899110] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-281" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.899492] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-281" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.899880] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.900102] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.900260] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.900527] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.900679] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.900913] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.901059] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.901187] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.901316] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.901452] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.901559] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.901719] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.925926] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.926249] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.926717] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.926781] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-281" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.927428] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-2a6988b0-e558-48a1-a24a-2b342cda1a67 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.927605] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-2a6988b0-e558-48a1-a24a-2b342cda1a67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.927799] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-2a6988b0-e558-48a1-a24a-2b342cda1a67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.928255] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-2a6988b0-e558-48a1-a24a-2b342cda1a67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.928255] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6988b0-e558-48a1-a24a-2b342cda1a67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.958939] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.959065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.959124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.959324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.959413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.959599] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.959704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.959758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.960053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.960177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.960292] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 already deleted. [ 732.960368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.026216] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.026362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.027018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.027018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.027018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.027018] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f is going to be created. [ 733.051748] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.051980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.052118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.052398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.052640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.067733] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f in Status: UNINITIALIZED for 2s [ 733.431410] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.431623] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.431742] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.432037] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.432180] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.432328] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 2a6988b0-e558-48a1-a24a-2b342cda1a67 not found, creating... [ 733.432616] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.432737] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.432842] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.433068] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.433219] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.433554] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.433707] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.433917] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.434017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.434216] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.434349] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 2a6988b0-e558-48a1-a24a-2b342cda1a67 is going to be created. [ 733.460112] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.460112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.460112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.460112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.460112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.460112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-2a6988b0-e558-48a1-a24a-2b342cda1a67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.872898] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: SUCCESS [ 733.873285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.877045] env[65992]: INFO networking_nsxv3.common.synchronization [req-2906930d-e043-4258-8768-8c4b461d92d3 req-d940c42d-6fe5-4879-894f-56af43dfe9ea tempest-SecurityGroupRulesTestJSON-844375077 tempest-SecurityGroupRulesTestJSON-844375077-project-member] Enqueued Resource ID: 06d42541-5f39-4ce2-9c06-30ee077839ca with Priority: HIGHEST for action security_group_rules [ 733.877731] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d42541-5f39-4ce2-9c06-30ee077839ca with Priority: HIGHEST for action security_group_rules [ 733.878813] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d42541-5f39-4ce2-9c06-30ee077839ca taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.878960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d42541-5f39-4ce2-9c06-30ee077839ca" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.879115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d42541-5f39-4ce2-9c06-30ee077839ca" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.879367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d42541-5f39-4ce2-9c06-30ee077839ca" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.879472] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d42541-5f39-4ce2-9c06-30ee077839ca',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.293453] env[65992]: INFO networking_nsxv3.common.synchronization [req-a7024261-be9b-41eb-b83d-57b23b27838a req-a29cea6e-16d0-415f-95c7-82f1fd1579a3 service nova] Enqueued Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGHEST for action security_group_rules [ 734.293751] env[65992]: INFO networking_nsxv3.common.synchronization [req-a7024261-be9b-41eb-b83d-57b23b27838a req-a29cea6e-16d0-415f-95c7-82f1fd1579a3 service nova] Enqueued Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGHEST for action security_group_members [ 734.293803] env[65992]: INFO networking_nsxv3.common.synchronization [req-a7024261-be9b-41eb-b83d-57b23b27838a req-a29cea6e-16d0-415f-95c7-82f1fd1579a3 service nova] Enqueued Resource ID: 2a6988b0-e558-48a1-a24a-2b342cda1a67 with Priority: HIGHEST for action port [ 734.294352] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGHEST for action security_group_rules [ 734.294773] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGHEST for action security_group_members [ 734.294773] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a6988b0-e558-48a1-a24a-2b342cda1a67 with Priority: HIGHEST for action port [ 734.294881] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.295050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.295473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.295838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.295927] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.297185] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffb03a45-85bd-476b-b6c0-c61a67ecca90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.297313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.297379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.297699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.297876] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.297983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.298056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.298212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.298295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.298388] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.301414] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a6988b0-e558-48a1-a24a-2b342cda1a67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.303747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a6988b0-e558-48a1-a24a-2b342cda1a67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.303747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a6988b0-e558-48a1-a24a-2b342cda1a67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.303747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a6988b0-e558-48a1-a24a-2b342cda1a67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.303747] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a6988b0-e558-48a1-a24a-2b342cda1a67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.401454] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.401690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.401788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.402222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.402330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.402430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d42541-5f39-4ce2-9c06-30ee077839ca already deleted. [ 734.403063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d42541-5f39-4ce2-9c06-30ee077839ca" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.801826] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.806432] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a6988b0-e558-48a1-a24a-2b342cda1a67 with status ACTIVE [ 734.807300] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.807300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.807300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.807300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.807530] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.807762] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.807895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.808373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.808373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.808373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.808571] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.808642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.808642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.808829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.808948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.809722] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a6988b0-e558-48a1-a24a-2b342cda1a67 is going to be updated. [ 734.811132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffb03a45-85bd-476b-b6c0-c61a67ecca90 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.811132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.833805] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.834131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.834255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.834478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.834647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.834822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a6988b0-e558-48a1-a24a-2b342cda1a67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.078566] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f in Status: SUCCESS [ 735.078810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.079020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.079266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.079472] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.079592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.079657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.079811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.079895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.079993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.080100] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.307691] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.582998] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4846c43f-6807-48c3-8d2a-ba94d8295f7f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.583252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.583354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.583598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.583783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.583897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.583995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.584219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.584278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.584341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.584533] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4846c43f-6807-48c3-8d2a-ba94d8295f7f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.584644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.584733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.585466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.585466] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.585466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.585466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.585466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.585466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.585466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.585782] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.677328] env[65992]: INFO networking_nsxv3.common.synchronization [req-ba663edf-bb06-4d5d-a952-6953e43c565f req-8ef1a24d-c3c8-4dd4-a6b9-dda1db1e3121 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 735.678150] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 735.678503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.678744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.678823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.679082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.679282] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.679407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.679465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.679660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.679747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.679802] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.703758] env[65992]: INFO networking_nsxv3.common.synchronization [req-ba663edf-bb06-4d5d-a952-6953e43c565f req-8ef1a24d-c3c8-4dd4-a6b9-dda1db1e3121 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 735.704129] env[65992]: INFO networking_nsxv3.common.synchronization [req-ba663edf-bb06-4d5d-a952-6953e43c565f req-8ef1a24d-c3c8-4dd4-a6b9-dda1db1e3121 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 735.704355] env[65992]: INFO networking_nsxv3.common.synchronization [req-ba663edf-bb06-4d5d-a952-6953e43c565f req-8ef1a24d-c3c8-4dd4-a6b9-dda1db1e3121 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with Priority: HIGHEST for action port [ 735.705330] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 735.705544] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 735.705752] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with Priority: HIGHEST for action port [ 735.706560] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.706961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.706961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.707187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.707238] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.708634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.709699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.711372] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.711372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.711520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.711667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.711777] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4114f001-f0b2-4aa7-bb1f-5a51d3a656b3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.812186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.812379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.812426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.812736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.812736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.812855] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 is going to be created. [ 735.841964] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.841964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.841964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.842327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.842513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.855333] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 in Status: UNINITIALIZED for 2s [ 736.087907] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4846c43f-6807-48c3-8d2a-ba94d8295f7f: rpc.has_security_group_logging(os_id): False [ 736.107803] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.108064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.108111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.108292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.108381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.108609] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.108731] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.108786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.108911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.108984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.109171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.109254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.109340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.109452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.109527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.109706] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.109796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.109867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.109988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.110159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.110246] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f is going to be created. [ 736.177047] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.177047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.177047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.177047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.177047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.182161] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.193133] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f in Status: IN_PROGRESS for 2s [ 736.213905] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.214060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.216566] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with status ACTIVE [ 736.217117] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.217295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.217387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.217623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.217737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.217930] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.218115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.218115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.218260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.218333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.218513] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.218605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.218669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.218826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.218894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.218976] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 is going to be updated. [ 736.276978] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.276978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.276978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.276978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.276978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.277849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.683805] env[65992]: INFO networking_nsxv3.common.synchronization [req-1b84d1c3-7617-4510-9e9f-6b2bc552f289 req-38f31b8f-2a29-4d08-867b-96f1d40f88bc tempest-ServersAdminNegativeTestJSON-1396292550 tempest-ServersAdminNegativeTestJSON-1396292550-project-member] Enqueued Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 736.686296] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.691636] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 736.692865] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.693028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.693028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.693276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.693516] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.693679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.693824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.694090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.694266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.694420] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.193084] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.193951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.193951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.193951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.193951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.194201] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be updated. [ 737.199416] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.231576] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.231829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.231920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.232130] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.232483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.246040] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: IN_PROGRESS for 2s [ 737.350166] env[65992]: INFO networking_nsxv3.common.synchronization [req-befb694a-f5b8-484a-b05f-d0828050e6b6 req-8c078b86-46b4-4720-9751-de51d89cc612 tempest-InstanceActionsV221TestJSON-1390411719 tempest-InstanceActionsV221TestJSON-1390411719-project-member] Enqueued Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGHEST for action security_group_members [ 737.350907] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGHEST for action security_group_members [ 737.353315] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-df0ad3c9-7e54-40f4-a88a-89bc030489f8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.353837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.353938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.355893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.356096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.356223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.356263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.356548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.356548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.356637] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.701897] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.863445] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.864210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.864602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.864976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.865111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.866883] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.866883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.866883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.866883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.866883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.866883] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 is going to be updated. [ 737.870228] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 in Status: SUCCESS [ 737.870639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.870854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.871136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.871379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.871532] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.871621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.871843] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.871992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.873372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.873372] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.895836] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.896277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.896395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.896686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.896917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.908719] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 in Status: IN_PROGRESS for 2s [ 737.981978] env[65992]: INFO networking_nsxv3.common.synchronization [req-e5c36296-3624-46c8-b8c2-cb60ce193f69 req-90d6d5e6-d5bd-4cfc-be88-b4e7072541b2 tempest-ServersTestJSON-1987185259 tempest-ServersTestJSON-1987185259-project-member] Enqueued Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_members [ 737.983439] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f with Priority: HIGHEST for action security_group_members [ 737.983439] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b14e2cad-daae-4705-9dc6-6e9de8cef89f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.983635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.983635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.983884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.984116] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.984192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.984252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.984521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.984521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.985112] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b14e2cad-daae-4705-9dc6-6e9de8cef89f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.206351] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.206351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.206351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.206351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.206351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.206351] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b is going to be updated. [ 738.210761] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f in Status: SUCCESS [ 738.210761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.261341] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.261341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.261341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.262097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.262097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.278602] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: IN_PROGRESS for 2s [ 738.376453] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffb03a45-85bd-476b-b6c0-c61a67ecca90 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.380111] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.380111] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffb03a45-85bd-476b-b6c0-c61a67ecca90 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.380111] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.380111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.381725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.382023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.382223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.382391] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.487451] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.487451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.487672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.488448] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.488448] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.488448] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.488672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.489315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.489315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.489315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.489315] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f is going to be updated. [ 738.538428] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.538721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.538721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.539028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.539063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.552440] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f in Status: IN_PROGRESS for 2s [ 738.887142] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffb03a45-85bd-476b-b6c0-c61a67ecca90: rpc.has_security_group_logging(os_id): False [ 738.913833] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.914092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.914176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.918027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.918027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.918027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.918027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.918733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.918733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.919323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.919323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.919323] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 is going to be created. [ 738.999038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.000842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.002058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.002368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.004171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.017932] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 in Status: IN_PROGRESS for 2s [ 739.260725] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 739.261350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.261350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.261562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.261754] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.261887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.261950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.262177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.262267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.262399] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.392475] env[65992]: INFO networking_nsxv3.common.synchronization [None req-79e7d179-5906-49b5-a4c9-0e3a09560b32 None None] Enqueued Resource ID: 52593c9b-b520-4acf-be44-13ba80ba18d5 with Priority: HIGHEST for action port [ 739.392894] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52593c9b-b520-4acf-be44-13ba80ba18d5 with Priority: HIGHEST for action port [ 739.393216] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-52593c9b-b520-4acf-be44-13ba80ba18d5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.393343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52593c9b-b520-4acf-be44-13ba80ba18d5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.393412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52593c9b-b520-4acf-be44-13ba80ba18d5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.393665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52593c9b-b520-4acf-be44-13ba80ba18d5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.393753] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52593c9b-b520-4acf-be44-13ba80ba18d5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.765786] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.897147] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52593c9b-b520-4acf-be44-13ba80ba18d5 [ 739.897473] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.897542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.898525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.898525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.898525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.898525] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52593c9b-b520-4acf-be44-13ba80ba18d5 already deleted. [ 739.898525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52593c9b-b520-4acf-be44-13ba80ba18d5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.925228] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 in Status: SUCCESS [ 739.925406] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 deletion is rescheduled due to dependency. [ 739.925525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.270163] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.294967] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: SUCCESS [ 740.294967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.313288] env[65992]: INFO networking_nsxv3.common.synchronization [req-d0d17297-303d-4461-8b11-edafc5f7481f req-f47be44e-0838-471a-8c14-08dde176e168 tempest-SecurityGroupRulesTestJSON-844375077 tempest-SecurityGroupRulesTestJSON-844375077-project-member] Enqueued Resource ID: 1833de54-203c-48d3-8714-5ef5406d6995 with Priority: HIGHEST for action security_group_rules [ 740.313288] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1833de54-203c-48d3-8714-5ef5406d6995 with Priority: HIGHEST for action security_group_rules [ 740.313288] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1833de54-203c-48d3-8714-5ef5406d6995 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.313864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1833de54-203c-48d3-8714-5ef5406d6995" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.314084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1833de54-203c-48d3-8714-5ef5406d6995" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.314474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1833de54-203c-48d3-8714-5ef5406d6995" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.316053] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1833de54-203c-48d3-8714-5ef5406d6995',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.567103] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f in Status: SUCCESS [ 740.567103] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b14e2cad-daae-4705-9dc6-6e9de8cef89f deletion is rescheduled due to dependency. [ 740.567103] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b14e2cad-daae-4705-9dc6-6e9de8cef89f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.774197] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.774901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.777412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.777412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.777412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.777412] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be updated. [ 740.823385] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.823723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.823723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.824254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.824420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.837578] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: IN_PROGRESS for 2s [ 740.838486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.838621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.838726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.839147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.839695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.839695] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1833de54-203c-48d3-8714-5ef5406d6995 already deleted. [ 740.839695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1833de54-203c-48d3-8714-5ef5406d6995" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.033198] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 in Status: SUCCESS [ 741.033577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.713136] env[65992]: INFO networking_nsxv3.common.synchronization [None req-8621c6da-bbff-4c9d-be14-7b955e38c7fa None None] Enqueued Resource ID: baa618cd-a246-43db-b62e-99590bbda0af with Priority: HIGHEST for action port [ 742.713707] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baa618cd-a246-43db-b62e-99590bbda0af with Priority: HIGHEST for action port [ 742.715174] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-baa618cd-a246-43db-b62e-99590bbda0af taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.715537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baa618cd-a246-43db-b62e-99590bbda0af" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.715609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baa618cd-a246-43db-b62e-99590bbda0af" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.716182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baa618cd-a246-43db-b62e-99590bbda0af" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.717555] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baa618cd-a246-43db-b62e-99590bbda0af',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.848503] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 742.848737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.848938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.849185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.849440] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.849627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.849762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.849975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.850098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.850407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.850407] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.224167] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port baa618cd-a246-43db-b62e-99590bbda0af [ 743.225140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.225287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.225387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.225578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.225765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.225883] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:baa618cd-a246-43db-b62e-99590bbda0af already deleted. [ 743.225974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baa618cd-a246-43db-b62e-99590bbda0af" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.354521] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.414226] env[65992]: INFO networking_nsxv3.common.synchronization [req-ed65e998-db77-4fd7-b671-516f1be78f15 req-d6da3ded-ddfa-49e2-aab3-174c2545e8e8 tempest-ServersNegativeTestJSON-1286688584 tempest-ServersNegativeTestJSON-1286688584-project-member] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 743.415049] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 743.415207] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.415323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.415507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.416773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.416773] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.416773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.416773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.416773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.416773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.416773] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.857314] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7: rpc.has_security_group_logging(os_id): False [ 743.878066] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.878251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.878339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.878742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.879018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.879363] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.879463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.879632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.879947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.880164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.880275] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be updated. [ 743.918894] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.918894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.918894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.921186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.921186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.921186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.921186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.921186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.921186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.921186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.921186] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 already deleted. [ 743.921186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.953181] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.953368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.953419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.953650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.953904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.969289] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: IN_PROGRESS for 2s [ 744.352296] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.352521] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.352657] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.353110] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.353423] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.353634] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.353868] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.354152] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.354296] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.354502] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.354606] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.354707] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.354809] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.354911] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.355016] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.355148] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.375837] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.376024] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.376186] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.376375] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.376908] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-e2cec206-c93b-4743-b0f8-e06217e357e8 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.377117] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.377234] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.377555] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.377686] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2cec206-c93b-4743-b0f8-e06217e357e8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.621755] env[65992]: INFO networking_nsxv3.common.synchronization [None req-4ab2acd6-c7a6-4f13-a682-88c12053e00e None None] Enqueued Resource ID: f16fa435-f361-411e-9363-5be58cfed40a with Priority: HIGHEST for action port [ 744.622063] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f16fa435-f361-411e-9363-5be58cfed40a with Priority: HIGHEST for action port [ 744.622501] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f16fa435-f361-411e-9363-5be58cfed40a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.622634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f16fa435-f361-411e-9363-5be58cfed40a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.622697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f16fa435-f361-411e-9363-5be58cfed40a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.622989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f16fa435-f361-411e-9363-5be58cfed40a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.623156] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f16fa435-f361-411e-9363-5be58cfed40a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.880545] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.880951] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.880997] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.881301] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.881603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.881867] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port e2cec206-c93b-4743-b0f8-e06217e357e8 not found, creating... [ 744.882287] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.882535] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.882749] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.883089] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.883323] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.883695] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.883924] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.884095] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.884370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.884589] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.884729] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: e2cec206-c93b-4743-b0f8-e06217e357e8 is going to be created. [ 744.907413] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.907693] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.907839] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.908138] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.908365] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.908835] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.125544] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f16fa435-f361-411e-9363-5be58cfed40a [ 745.125868] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.126026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.126107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.126854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.126854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.126854] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f16fa435-f361-411e-9363-5be58cfed40a already deleted. [ 745.126854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f16fa435-f361-411e-9363-5be58cfed40a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.694703] env[65992]: INFO networking_nsxv3.common.synchronization [req-ed65e998-db77-4fd7-b671-516f1be78f15 req-0d266f66-aadc-42c2-a025-f30f4795a353 service nova] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_rules [ 745.694812] env[65992]: INFO networking_nsxv3.common.synchronization [req-ed65e998-db77-4fd7-b671-516f1be78f15 req-0d266f66-aadc-42c2-a025-f30f4795a353 service nova] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 745.694934] env[65992]: INFO networking_nsxv3.common.synchronization [req-ed65e998-db77-4fd7-b671-516f1be78f15 req-0d266f66-aadc-42c2-a025-f30f4795a353 service nova] Enqueued Resource ID: e2cec206-c93b-4743-b0f8-e06217e357e8 with Priority: HIGHEST for action port [ 745.696150] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_rules [ 745.696150] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 745.696150] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cec206-c93b-4743-b0f8-e06217e357e8 with Priority: HIGHEST for action port [ 745.696377] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.696470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.696565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.696793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.696881] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.698501] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.698656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.699707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.699707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.699707] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.699707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.699707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.699969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.700034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.700226] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.701057] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2cec206-c93b-4743-b0f8-e06217e357e8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.701202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.701241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.701406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.701497] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2cec206-c93b-4743-b0f8-e06217e357e8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.985907] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 745.986947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.030304] env[65992]: INFO networking_nsxv3.common.synchronization [req-21354ed6-1bd4-4d06-ab39-531f84160ab5 req-3f80eedd-fd5e-4efd-841e-31f3677c869d tempest-FloatingIPsAssociationTestJSON-1610940676 tempest-FloatingIPsAssociationTestJSON-1610940676-project-member] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 746.031314] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 746.031416] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.031556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.031599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.031862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.032304] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.032304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.032304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.032560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.032641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.032790] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.205421] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.207854] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.207985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.210131] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2cec206-c93b-4743-b0f8-e06217e357e8 with status ACTIVE [ 746.210356] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.210682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.210682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.210809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.210857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.211059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.214241] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.214241] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2cec206-c93b-4743-b0f8-e06217e357e8 is going to be updated. [ 746.239267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.239428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.239499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.239827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.240281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.240569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.498717] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.498950] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-712" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.499145] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-712" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.499494] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-712" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.499829] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.500104] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.500305] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.500585] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.500748] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.500956] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.501109] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.501220] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.501323] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.501429] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.501527] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.501651] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.522749] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.523328] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.523328] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.523328] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-712" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.523564] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.523787] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.523859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.524254] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.524424] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.535208] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.535563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.535563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.535675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.535742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.535983] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.536083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.536135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.536287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.536365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.536448] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 already deleted. [ 746.536527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.544333] env[65992]: INFO networking_nsxv3.common.synchronization [None req-5af2d371-6ba0-4fdb-a978-0ff7d005886f None None] Enqueued Resource ID: cdd3c345-d0d3-4d0d-8a61-31810f49744d with Priority: HIGHEST for action port [ 746.544584] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdd3c345-d0d3-4d0d-8a61-31810f49744d with Priority: HIGHEST for action port [ 746.545159] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdd3c345-d0d3-4d0d-8a61-31810f49744d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.545276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdd3c345-d0d3-4d0d-8a61-31810f49744d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.545338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdd3c345-d0d3-4d0d-8a61-31810f49744d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.545601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdd3c345-d0d3-4d0d-8a61-31810f49744d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.545728] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd3c345-d0d3-4d0d-8a61-31810f49744d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.717124] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.028475] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.029017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.029017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.029351] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.029610] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.029872] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9 not found, creating... [ 747.032167] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.033565] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.033565] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.033674] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.033744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.034122] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.034285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.034394] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.034652] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.034781] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.034921] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9 is going to be created. [ 747.037631] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e3c75b4d-9d2e-4fa3-94c3-1286abde48f9 None None] Enqueued Resource ID: bf332893-8e81-40d4-98a9-cef86151bb6f with Priority: HIGHEST for action port [ 747.042132] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf332893-8e81-40d4-98a9-cef86151bb6f with Priority: HIGHEST for action port [ 747.042876] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf332893-8e81-40d4-98a9-cef86151bb6f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.043038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf332893-8e81-40d4-98a9-cef86151bb6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.043144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf332893-8e81-40d4-98a9-cef86151bb6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.043421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf332893-8e81-40d4-98a9-cef86151bb6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.043500] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf332893-8e81-40d4-98a9-cef86151bb6f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.049319] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdd3c345-d0d3-4d0d-8a61-31810f49744d [ 747.049514] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.049641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.049710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.049936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.050059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.050170] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdd3c345-d0d3-4d0d-8a61-31810f49744d already deleted. [ 747.050256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdd3c345-d0d3-4d0d-8a61-31810f49744d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.061517] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.061517] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.062928] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.062928] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.062928] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.062928] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.221567] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.221841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.221959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.222414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.222872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.223067] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be created. [ 747.283231] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.283231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.283231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.283577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.283836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.301303] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: UNINITIALIZED for 2s [ 747.545548] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf332893-8e81-40d4-98a9-cef86151bb6f [ 747.545821] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.545958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.546044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.546609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.546609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.546609] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf332893-8e81-40d4-98a9-cef86151bb6f already deleted. [ 747.546609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf332893-8e81-40d4-98a9-cef86151bb6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.795134] env[65992]: INFO networking_nsxv3.common.synchronization [req-21354ed6-1bd4-4d06-ab39-531f84160ab5 req-dd13ca86-70fa-449b-b0f3-e36a1f3ac6bb service nova] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_rules [ 747.795336] env[65992]: INFO networking_nsxv3.common.synchronization [req-21354ed6-1bd4-4d06-ab39-531f84160ab5 req-dd13ca86-70fa-449b-b0f3-e36a1f3ac6bb service nova] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 747.795470] env[65992]: INFO networking_nsxv3.common.synchronization [req-21354ed6-1bd4-4d06-ab39-531f84160ab5 req-dd13ca86-70fa-449b-b0f3-e36a1f3ac6bb service nova] Enqueued Resource ID: de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9 with Priority: HIGHEST for action port [ 747.796037] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_rules [ 747.796172] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 747.796267] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9 with Priority: HIGHEST for action port [ 747.798171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.798265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.798345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.798576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.798661] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.799594] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.799678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.799757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.799915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.800122] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.800221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.800261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.800389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.800472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.800559] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.805038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.805162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.805231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.805396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.805472] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.307913] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.308355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.308355] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.309251] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9 with status ACTIVE [ 748.309467] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.309596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.309662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.309869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.309958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.310164] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.310269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.310327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.310576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.310576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.310729] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.310815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.310883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.311641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.311755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.311845] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9 is going to be updated. [ 748.334371] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.334668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.334668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.334945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.335188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.335399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de911b7d-f8cb-4b9e-9ca4-80db0cdad7c9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.815081] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.993598] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c59f6d81-0093-4740-9abe-a59d2635963f None None] Enqueued Resource ID: 1249a609-8710-4c67-8efd-08cc4ee39a9c with Priority: HIGHEST for action port [ 748.994275] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1249a609-8710-4c67-8efd-08cc4ee39a9c with Priority: HIGHEST for action port [ 748.995412] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-1249a609-8710-4c67-8efd-08cc4ee39a9c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.995541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1249a609-8710-4c67-8efd-08cc4ee39a9c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.995608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1249a609-8710-4c67-8efd-08cc4ee39a9c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.995924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1249a609-8710-4c67-8efd-08cc4ee39a9c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.996040] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1249a609-8710-4c67-8efd-08cc4ee39a9c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.314076] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 749.314076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.314495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.314495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.314593] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.314712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.314777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.314929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.315019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.315202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.315360] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.316607] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.316755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.316843] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.317037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.317175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.317291] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be created. [ 749.345545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.345704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.345753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.346021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.346215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.357962] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: UNINITIALIZED for 2s [ 749.499445] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1249a609-8710-4c67-8efd-08cc4ee39a9c [ 749.499723] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.499882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.499959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.500298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.500367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.500470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1249a609-8710-4c67-8efd-08cc4ee39a9c already deleted. [ 749.500565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1249a609-8710-4c67-8efd-08cc4ee39a9c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.820418] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.820640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.820684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.820982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.821233] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.821386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.821457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.822420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.822420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.822420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.822420] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.822420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.822420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.822658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.822658] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.822733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.822834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.823080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.823176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.823363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.823363] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.985047] env[65992]: INFO networking_nsxv3.common.synchronization [None req-a3539866-7491-47a8-a6ba-4e1d82525528 None None] Enqueued Resource ID: 6222128e-d6ba-41cd-aae8-5672716dff7b with Priority: HIGHEST for action port [ 749.985239] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6222128e-d6ba-41cd-aae8-5672716dff7b with Priority: HIGHEST for action port [ 749.986067] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-6222128e-d6ba-41cd-aae8-5672716dff7b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.986225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6222128e-d6ba-41cd-aae8-5672716dff7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.986318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6222128e-d6ba-41cd-aae8-5672716dff7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.986598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6222128e-d6ba-41cd-aae8-5672716dff7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.986685] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6222128e-d6ba-41cd-aae8-5672716dff7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.325984] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6: rpc.has_security_group_logging(os_id): False [ 750.351700] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.351845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.351891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.352147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.353325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.353325] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.353325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.353325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.353325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.353325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.353325] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.353325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.353325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.353855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.353855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.353926] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.356236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.356236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.356236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.356236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.356236] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be created. [ 750.435080] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.435213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.435329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.435712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.435999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.455780] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: IN_PROGRESS for 2s [ 750.489308] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6222128e-d6ba-41cd-aae8-5672716dff7b [ 750.489616] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.489788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.489838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.490255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.490255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.490361] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6222128e-d6ba-41cd-aae8-5672716dff7b already deleted. [ 750.490997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6222128e-d6ba-41cd-aae8-5672716dff7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.371892] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: SUCCESS [ 751.371892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.371892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.371892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.371892] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.371892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.371892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.371892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.371892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.371892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.371892] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.440657] env[65992]: INFO networking_nsxv3.common.synchronization [None req-72447f4c-04f3-4ef1-8e5a-89e39e9eba61 None None] Enqueued Resource ID: c09f36da-a912-4974-b249-2421d773d5c2 with Priority: HIGHEST for action port [ 751.440657] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c09f36da-a912-4974-b249-2421d773d5c2 with Priority: HIGHEST for action port [ 751.440657] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c09f36da-a912-4974-b249-2421d773d5c2 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.440657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c09f36da-a912-4974-b249-2421d773d5c2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.440657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c09f36da-a912-4974-b249-2421d773d5c2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.440657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c09f36da-a912-4974-b249-2421d773d5c2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.442123] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c09f36da-a912-4974-b249-2421d773d5c2',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.874548] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.874814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.874936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.875328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.875621] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.875763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.875906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.876096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.876195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.876289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.876451] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.876550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.876613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.876767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.876921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.880170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.880170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.880636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.880636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.880636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.880810] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.945560] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c09f36da-a912-4974-b249-2421d773d5c2 [ 751.945748] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.945971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.946104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.946700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.946700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.946700] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c09f36da-a912-4974-b249-2421d773d5c2 already deleted. [ 751.946700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c09f36da-a912-4974-b249-2421d773d5c2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.232744] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f608e9c9-7b1a-472f-a7d5-331481d4b747 tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 752.233825] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 752.234591] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.234591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.234591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.234591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.234882] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.383200] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d26e35f-7f74-471f-aa86-2ea84a3690b8: rpc.has_security_group_logging(os_id): False [ 752.405839] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.406258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.406415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.406830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.407088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.407423] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.407992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.407992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.408142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.408142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.408417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.408752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.408752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.408752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.409125] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.409125] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.409271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.409271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.409402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.409402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.409510] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be created. [ 752.468800] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 752.469078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.486097] env[65992]: INFO networking_nsxv3.common.synchronization [None req-03f3859c-eccc-4d18-ba20-64cbdda657c5 tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 752.487163] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 752.487461] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.487551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.494008] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.494163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.494263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.494563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.494744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.510425] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: IN_PROGRESS for 2s [ 752.756498] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.758630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.758630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.758630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.758630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.758630] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 already deleted. [ 752.758630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.758630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.758630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.758630] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.286851] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.287887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.287887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.287887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.287887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.287887] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 already deleted. [ 753.287887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.436566] env[65992]: INFO networking_nsxv3.common.synchronization [req-635621bf-3976-425d-ad84-8c854f9db717 req-9c4001f5-78bd-41de-b50b-d3e1f69190b4 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 754.437189] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 754.437501] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.437624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.437688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.440035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.440035] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.440035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.440035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.440419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.440457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.440568] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.456929] env[65992]: INFO networking_nsxv3.common.synchronization [req-635621bf-3976-425d-ad84-8c854f9db717 req-9c4001f5-78bd-41de-b50b-d3e1f69190b4 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 754.457204] env[65992]: INFO networking_nsxv3.common.synchronization [req-635621bf-3976-425d-ad84-8c854f9db717 req-9c4001f5-78bd-41de-b50b-d3e1f69190b4 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 754.457395] env[65992]: INFO networking_nsxv3.common.synchronization [req-635621bf-3976-425d-ad84-8c854f9db717 req-9c4001f5-78bd-41de-b50b-d3e1f69190b4 tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with Priority: HIGHEST for action port [ 754.458192] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_rules [ 754.458373] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 754.458503] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with Priority: HIGHEST for action port [ 754.458799] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.458943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.459026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.459238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.459320] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.460245] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.460361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.460571] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.460680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.460770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.461897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.461897] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4114f001-f0b2-4aa7-bb1f-5a51d3a656b3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.525261] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: SUCCESS [ 754.525261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.943468] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.963175] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.963375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.964676] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 with status ACTIVE [ 754.965008] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.965170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.965239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.965452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.965542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.965744] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.965918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.965918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.966280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.966280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.966499] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.966499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.966499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.966688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.966688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.966788] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4114f001-f0b2-4aa7-bb1f-5a51d3a656b3 is going to be updated. [ 755.002680] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.002800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.002879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.003097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.003284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.003385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4114f001-f0b2-4aa7-bb1f-5a51d3a656b3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.294815] env[65992]: INFO networking_nsxv3.common.synchronization [req-86e3dd23-f082-4fc7-820e-35533c8bfec4 req-1e25f75e-be94-4546-abc7-ba26a838b3bf tempest-SecurityGroupRulesTestJSON-844375077 tempest-SecurityGroupRulesTestJSON-844375077-project-member] Enqueued Resource ID: 243460b8-cf55-48c8-b319-46313259a10d with Priority: HIGHEST for action security_group_rules [ 755.296831] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 243460b8-cf55-48c8-b319-46313259a10d with Priority: HIGHEST for action security_group_rules [ 755.296831] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-243460b8-cf55-48c8-b319-46313259a10d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.296831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-243460b8-cf55-48c8-b319-46313259a10d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.296831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-243460b8-cf55-48c8-b319-46313259a10d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.296831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-243460b8-cf55-48c8-b319-46313259a10d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.296831] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('243460b8-cf55-48c8-b319-46313259a10d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.446169] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.826552] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.826552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.826552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.827170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.827170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.827170] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 243460b8-cf55-48c8-b319-46313259a10d already deleted. [ 755.827170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-243460b8-cf55-48c8-b319-46313259a10d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.833127] env[65992]: INFO networking_nsxv3.common.synchronization [None req-934673ab-4038-4290-ac58-86046620b6b6 tempest-MigrationsAdminTest-1940019867 tempest-MigrationsAdminTest-1940019867-project-member] Enqueued Resource ID: f5595a13-e235-47fe-936a-ea704f0dc56e with Priority: HIGHEST for action security_group_rules [ 755.833127] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5595a13-e235-47fe-936a-ea704f0dc56e with Priority: HIGHEST for action security_group_rules [ 755.833276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5595a13-e235-47fe-936a-ea704f0dc56e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.833377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5595a13-e235-47fe-936a-ea704f0dc56e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.833377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5595a13-e235-47fe-936a-ea704f0dc56e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.833915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5595a13-e235-47fe-936a-ea704f0dc56e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.833915] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5595a13-e235-47fe-936a-ea704f0dc56e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.951379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.951620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.951729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.952220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.952545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.952545] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be updated. [ 755.992217] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.992485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.994029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.994029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.994029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.006045] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: IN_PROGRESS for 2s [ 756.017584] env[65992]: INFO networking_nsxv3.common.synchronization [None req-217a0d8f-a50f-4209-8644-6b7d42e53979 tempest-MigrationsAdminTest-1940019867 tempest-MigrationsAdminTest-1940019867-project-member] Enqueued Resource ID: f5595a13-e235-47fe-936a-ea704f0dc56e with Priority: HIGHEST for action security_group_rules [ 756.017584] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5595a13-e235-47fe-936a-ea704f0dc56e with Priority: HIGHEST for action security_group_rules [ 756.018112] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5595a13-e235-47fe-936a-ea704f0dc56e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.018112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5595a13-e235-47fe-936a-ea704f0dc56e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.357743] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.357990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.358080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.358312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.358403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.358499] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5595a13-e235-47fe-936a-ea704f0dc56e already deleted. [ 756.358592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5595a13-e235-47fe-936a-ea704f0dc56e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.358747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5595a13-e235-47fe-936a-ea704f0dc56e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.358917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5595a13-e235-47fe-936a-ea704f0dc56e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.358990] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5595a13-e235-47fe-936a-ea704f0dc56e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.887796] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.887796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.887796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.887796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.887796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.887796] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5595a13-e235-47fe-936a-ea704f0dc56e already deleted. [ 756.887796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5595a13-e235-47fe-936a-ea704f0dc56e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.354138] env[65992]: INFO networking_nsxv3.common.synchronization [req-198ac0ce-b349-48c2-95e3-13fa567ecccf req-45e6388e-9cd1-4882-8f35-b0a11b80a181 tempest-ImagesNegativeTestJSON-405197654 tempest-ImagesNegativeTestJSON-405197654-project-member] Enqueued Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGHEST for action security_group_members [ 757.354765] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGHEST for action security_group_members [ 757.357218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffb03a45-85bd-476b-b6c0-c61a67ecca90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.357388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.357488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.357678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.360263] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.360429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.360481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.360959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.360959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.360959] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.863884] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.864181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.864274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.864560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.864698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.864981] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.865142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.865254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.865496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.865587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.865690] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 is going to be updated. [ 757.920249] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.920590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.920590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.920670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.920848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.935197] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 in Status: IN_PROGRESS for 2s [ 758.019345] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 758.019469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.019612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.019841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.020041] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.020516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.020583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.020761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.020877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.020992] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.523421] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.570038] env[65992]: INFO networking_nsxv3.common.synchronization [req-dc2ba9dc-ee18-4359-9711-26767a42f2b4 req-222a0cf7-5415-4c7a-a8ef-9fb0fd322b7c tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 758.570362] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 758.570694] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.570818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.570885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.571815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.574140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.574140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.574140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.574140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.574140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.574140] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.026495] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.077779] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.077966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.078043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.078267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.078381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.078612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.078728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.078793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.079032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.079121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.079236] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 759.152502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.152718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.152752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.152950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.153114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.165479] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 759.392430] env[65992]: INFO networking_nsxv3.common.synchronization [req-6e08e57d-c6fd-4992-a4c8-7cd6d8d80a8b req-aa87c640-526f-4a3d-a5cc-5948207f0ad6 tempest-SecurityGroupRulesTestJSON-844375077 tempest-SecurityGroupRulesTestJSON-844375077-project-member] Enqueued Resource ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 with Priority: HIGHEST for action security_group_rules [ 759.393339] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 with Priority: HIGHEST for action security_group_rules [ 759.393786] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecf33d50-7d4e-4deb-a112-59f26d329e59 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.393983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.394118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.394466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.394625] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecf33d50-7d4e-4deb-a112-59f26d329e59',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.530703] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.530931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.530976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.531233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.531351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531434] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be updated. [ 759.585432] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.585796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.585965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.586381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.586381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.596691] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: IN_PROGRESS for 2s [ 759.921251] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.921388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.921453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.921681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.921762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.921889] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 already deleted. [ 759.921923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.944988] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 in Status: SUCCESS [ 759.944988] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 deletion is rescheduled due to dependency. [ 759.944988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.135598] env[65992]: INFO networking_nsxv3.common.synchronization [req-48ed1b33-25aa-4867-8411-73c4cbebd1a6 req-b4b782be-3518-44dd-b2de-42ff0b2231ae tempest-SecurityGroupRulesTestJSON-844375077 tempest-SecurityGroupRulesTestJSON-844375077-project-member] Enqueued Resource ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 with Priority: HIGHEST for action security_group_rules [ 760.136166] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 with Priority: HIGHEST for action security_group_rules [ 760.136454] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecf33d50-7d4e-4deb-a112-59f26d329e59 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.136575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.136698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.136839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.136949] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecf33d50-7d4e-4deb-a112-59f26d329e59',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.661717] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.661717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.661717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.661875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.661921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.662043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 already deleted. [ 760.662248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.684019] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f13afc2-abd2-44c7-8691-ff2f011d6483 req-44ef00aa-c572-474d-9821-fd26763e575e tempest-AttachInterfacesUnderV243Test-1401351605 tempest-AttachInterfacesUnderV243Test-1401351605-project-member] Enqueued Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 760.684926] env[65992]: INFO networking_nsxv3.common.synchronization [req-ec4311c4-ee9f-4c65-ac40-0de0e4aaa555 req-7563f4db-1c92-410f-bec3-3246c3404098 tempest-ServersAdminNegativeTestJSON-1396292550 tempest-ServersAdminNegativeTestJSON-1396292550-project-member] Enqueued Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 760.685432] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 with Priority: HIGHEST for action security_group_members [ 760.685566] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8c9176-c0d4-4732-93ba-a80e6182488b with Priority: HIGHEST for action security_group_members [ 760.685836] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.685978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.686202] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8c9176-c0d4-4732-93ba-a80e6182488b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.686355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.686434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.686650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.686797] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.686894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.686954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.687123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.687224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.687567] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8c9176-c0d4-4732-93ba-a80e6182488b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.183383] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 761.184154] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a deletion is rescheduled due to dependency. [ 761.184154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.191839] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.192620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.192620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.192620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.193045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.193045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.193254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.193254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.193409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.193548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.193650] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b is going to be updated. [ 761.234100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.234382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.234752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.234752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.234897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.246725] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: IN_PROGRESS for 2s [ 761.618433] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 761.618792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.619037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.619301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.619533] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.619661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.619752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.619948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.620079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.620198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.620354] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.623304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.624014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.624014] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.624014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.624014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.624506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.624506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.624506] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.127067] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.129384] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.129536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.129650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.129814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.129904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.130680] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.130680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.130680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.130680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.130680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.130680] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be updated. [ 762.165028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.165028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.165028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.165028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.165028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.166553] env[65992]: INFO networking_nsxv3.common.synchronization [req-abb7384e-d3fd-4f0f-9c0a-4b651efd6bf4 req-d85f5618-e20f-4e6d-8aa0-aff3d08c2e2d tempest-VolumesAssistedSnapshotsTest-699681554 tempest-VolumesAssistedSnapshotsTest-699681554-project-member] Enqueued Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_members [ 762.167265] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGHEST for action security_group_members [ 762.167730] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5ce6400-2109-4c84-b2da-30e330c81a70 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.168040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.168222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.168507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.168771] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.169059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.169228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.169578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.169782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.169956] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.174707] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: IN_PROGRESS for 2s [ 762.633303] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7: rpc.has_security_group_logging(os_id): False [ 762.654637] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.654833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.654880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.655219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.655219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.655528] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.655651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.655651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.655803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.655879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.655966] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 is going to be updated. [ 762.672795] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.673021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.673178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.673428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.673428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.673561] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.673654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.673715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.673872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.673949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.674046] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5ce6400-2109-4c84-b2da-30e330c81a70 is going to be updated. [ 762.709162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.709162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.709162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.709162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.709162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.719060] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5ce6400-2109-4c84-b2da-30e330c81a70 in Status: IN_PROGRESS for 2s [ 762.728833] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.729032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.729122] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.729375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.729521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.771658] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: IN_PROGRESS for 2s [ 763.015247] env[65992]: INFO networking_nsxv3.common.synchronization [req-0ede63f8-1cc8-401c-9def-69378ccf3db2 req-db31b5c4-99ab-472c-95d8-34b3f22e6557 tempest-SecurityGroupRulesTestJSON-844375077 tempest-SecurityGroupRulesTestJSON-844375077-project-member] Enqueued Resource ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 with Priority: HIGHEST for action security_group_rules [ 763.015545] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 with Priority: HIGHEST for action security_group_rules [ 763.016077] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecf33d50-7d4e-4deb-a112-59f26d329e59 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.016281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.016398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.016698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.016813] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecf33d50-7d4e-4deb-a112-59f26d329e59',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.261427] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8c9176-c0d4-4732-93ba-a80e6182488b in Status: SUCCESS [ 763.261674] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8c9176-c0d4-4732-93ba-a80e6182488b deletion is rescheduled due to dependency. [ 763.261800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8c9176-c0d4-4732-93ba-a80e6182488b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.546911] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.547038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.547141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.547548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.547548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.547548] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecf33d50-7d4e-4deb-a112-59f26d329e59 already deleted. [ 763.547672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecf33d50-7d4e-4deb-a112-59f26d329e59" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.188524] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 764.188909] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 deletion is rescheduled due to dependency. [ 764.188961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.734319] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5ce6400-2109-4c84-b2da-30e330c81a70 in Status: SUCCESS [ 764.734749] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5ce6400-2109-4c84-b2da-30e330c81a70 deletion is rescheduled due to dependency. [ 764.734749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.787464] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7 in Status: SUCCESS [ 764.787703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.198913] env[65992]: INFO networking_nsxv3.common.synchronization [req-e99b62f9-6b90-4648-bc20-21e1ddb8073a req-fb22266f-4321-4ca1-810d-60f8350fa541 tempest-FloatingIPsAssociationNegativeTestJSON-602498819 tempest-FloatingIPsAssociationNegativeTestJSON-602498819-project-member] Enqueued Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGHEST for action security_group_members [ 766.199241] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGHEST for action security_group_members [ 766.199562] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.199711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.199804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.200128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.200339] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.200433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.200504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.200716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.201050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.201050] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.641279] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.641279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-974" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.641279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-974" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.641279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-974" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.641279] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.641279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.641279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.641279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.641279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.643413] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.643413] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.643413] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.643413] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.645794] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.645794] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.645794] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.664513] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.665416] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.665542] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.665818] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-974" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.666081] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-240443c2-b173-41be-a0b3-c2d75ea9a074 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.666306] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-240443c2-b173-41be-a0b3-c2d75ea9a074" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.666425] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-240443c2-b173-41be-a0b3-c2d75ea9a074" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.666790] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-240443c2-b173-41be-a0b3-c2d75ea9a074" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.666926] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240443c2-b173-41be-a0b3-c2d75ea9a074',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.704158] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.704158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.704158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.704158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.704158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.704158] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.704158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.704158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.704158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.704501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.704501] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7e4325-0a58-45b0-b4d0-e088a125232f already deleted. [ 766.704501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.176053] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.176053] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.176053] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.176053] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.176053] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.176053] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 240443c2-b173-41be-a0b3-c2d75ea9a074 not found, creating... [ 767.176053] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.176053] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.176053] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.176823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.176823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.177105] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.177246] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.177372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.177654] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.177797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.177954] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 240443c2-b173-41be-a0b3-c2d75ea9a074 is going to be created. [ 767.203739] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.204137] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.204206] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.204552] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.204855] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.205176] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-240443c2-b173-41be-a0b3-c2d75ea9a074" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.302295] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 767.302501] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent loop - iteration:1 started [ 767.913771] env[65992]: INFO networking_nsxv3.common.synchronization [req-e99b62f9-6b90-4648-bc20-21e1ddb8073a req-89c8dbfc-df65-44d7-9b12-4ec2c8938910 service nova] Enqueued Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGHEST for action security_group_rules [ 767.916026] env[65992]: INFO networking_nsxv3.common.synchronization [req-e99b62f9-6b90-4648-bc20-21e1ddb8073a req-89c8dbfc-df65-44d7-9b12-4ec2c8938910 service nova] Enqueued Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGHEST for action security_group_members [ 767.916026] env[65992]: INFO networking_nsxv3.common.synchronization [req-e99b62f9-6b90-4648-bc20-21e1ddb8073a req-89c8dbfc-df65-44d7-9b12-4ec2c8938910 service nova] Enqueued Resource ID: 240443c2-b173-41be-a0b3-c2d75ea9a074 with Priority: HIGHEST for action port [ 767.920486] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGHEST for action security_group_rules [ 767.920486] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGHEST for action security_group_members [ 767.920486] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240443c2-b173-41be-a0b3-c2d75ea9a074 with Priority: HIGHEST for action port [ 767.920486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.920486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.920486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.920486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.920486] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.920486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.920486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.920486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.921492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.925881] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.925881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.925881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.925881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.925881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.925881] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.927781] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-240443c2-b173-41be-a0b3-c2d75ea9a074 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.927961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-240443c2-b173-41be-a0b3-c2d75ea9a074" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.928074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-240443c2-b173-41be-a0b3-c2d75ea9a074" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.929532] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-240443c2-b173-41be-a0b3-c2d75ea9a074" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.929532] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240443c2-b173-41be-a0b3-c2d75ea9a074',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.341281] env[65992]: INFO networking_nsxv3.common.synchronization [req-bad568db-8425-48a7-b824-8b0aa6d14e27 req-c30a5701-5754-43b0-9daa-bf0424f72927 tempest-ServerActionsV293TestJSON-1691925799 tempest-ServerActionsV293TestJSON-1691925799-project-member] Enqueued Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_members [ 768.341281] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_members [ 768.341625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.341694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.341743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.342202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.342437] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.342598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.342697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.342923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.343801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.343953] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.430816] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.434157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.434157] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.434157] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 240443c2-b173-41be-a0b3-c2d75ea9a074 with status ACTIVE [ 768.434157] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.434157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.434157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.434157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.434157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.434157] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.434894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.435148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.435525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.435812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.436191] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.439482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.439482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.439482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.439482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.439482] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 240443c2-b173-41be-a0b3-c2d75ea9a074 is going to be updated. [ 768.466039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.466263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.466343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.466632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.467044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.467310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-240443c2-b173-41be-a0b3-c2d75ea9a074" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.847432] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.851031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.851031] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 already deleted. [ 768.851031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.852678] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.853239] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-259" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.853553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-259" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.854456] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-259" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.854825] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.855161] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.855474] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.855835] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.856099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.856432] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.856649] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.856855] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.857064] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.857268] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.859079] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.859079] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.884937] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.885119] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.885253] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.885491] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-259" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.885932] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-56edb008-534c-4c66-b84c-08c172eeb9d2 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.886272] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-56edb008-534c-4c66-b84c-08c172eeb9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.886375] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-56edb008-534c-4c66-b84c-08c172eeb9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.886684] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-56edb008-534c-4c66-b84c-08c172eeb9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.886875] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56edb008-534c-4c66-b84c-08c172eeb9d2',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.940281] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.389792] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.390407] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.390407] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.390586] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.390586] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.390749] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 56edb008-534c-4c66-b84c-08c172eeb9d2 not found, creating... [ 769.390980] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.391164] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.391278] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.391506] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.391704] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.391936] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.392570] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.394035] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.394035] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.394035] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.394035] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 56edb008-534c-4c66-b84c-08c172eeb9d2 is going to be created. [ 769.422381] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.422614] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.422779] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.423105] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.423390] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.423829] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-56edb008-534c-4c66-b84c-08c172eeb9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.443943] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.444093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.444172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.444438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.444544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.444646] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7e4325-0a58-45b0-b4d0-e088a125232f is going to be created. [ 769.474852] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.475331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.475331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.475467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.475499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.498338] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7e4325-0a58-45b0-b4d0-e088a125232f in Status: UNINITIALIZED for 2s [ 769.591424] env[65992]: INFO networking_nsxv3.common.synchronization [None req-66f28fa5-a756-4edc-95f0-b763a168aa3b None None] Enqueued Resource ID: e3404a42-1e4f-45a4-88b0-cea503836b62 with Priority: HIGHEST for action port [ 769.591424] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3404a42-1e4f-45a4-88b0-cea503836b62 with Priority: HIGHEST for action port [ 769.591668] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3404a42-1e4f-45a4-88b0-cea503836b62 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.593041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3404a42-1e4f-45a4-88b0-cea503836b62" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.593041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3404a42-1e4f-45a4-88b0-cea503836b62" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.593041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3404a42-1e4f-45a4-88b0-cea503836b62" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.593041] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3404a42-1e4f-45a4-88b0-cea503836b62',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.096796] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3404a42-1e4f-45a4-88b0-cea503836b62 [ 770.097018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.097152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.097215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.097667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.097667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.097667] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3404a42-1e4f-45a4-88b0-cea503836b62 already deleted. [ 770.097667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3404a42-1e4f-45a4-88b0-cea503836b62" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.135938] env[65992]: INFO networking_nsxv3.common.synchronization [req-bad568db-8425-48a7-b824-8b0aa6d14e27 req-502d05b5-a818-4d88-9b21-0453e0f69434 service nova] Enqueued Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_rules [ 770.136308] env[65992]: INFO networking_nsxv3.common.synchronization [req-bad568db-8425-48a7-b824-8b0aa6d14e27 req-502d05b5-a818-4d88-9b21-0453e0f69434 service nova] Enqueued Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_members [ 770.136399] env[65992]: INFO networking_nsxv3.common.synchronization [req-bad568db-8425-48a7-b824-8b0aa6d14e27 req-502d05b5-a818-4d88-9b21-0453e0f69434 service nova] Enqueued Resource ID: 56edb008-534c-4c66-b84c-08c172eeb9d2 with Priority: HIGHEST for action port [ 770.136974] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_rules [ 770.137408] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_members [ 770.137587] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56edb008-534c-4c66-b84c-08c172eeb9d2 with Priority: HIGHEST for action port [ 770.137985] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.138386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.139871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.140425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.140425] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.141377] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.141508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.141574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.141820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.141894] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.141992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.142121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.142409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.142409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.142556] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.143651] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-56edb008-534c-4c66-b84c-08c172eeb9d2 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.143755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56edb008-534c-4c66-b84c-08c172eeb9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.143839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56edb008-534c-4c66-b84c-08c172eeb9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.143968] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56edb008-534c-4c66-b84c-08c172eeb9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.144051] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56edb008-534c-4c66-b84c-08c172eeb9d2',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.647689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.647689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.647689] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.651828] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56edb008-534c-4c66-b84c-08c172eeb9d2 with status ACTIVE [ 770.653466] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.658597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.658597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.658597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.658597] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56edb008-534c-4c66-b84c-08c172eeb9d2 is going to be updated. [ 770.684793] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.684952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.685035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.685245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.685388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.685548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56edb008-534c-4c66-b84c-08c172eeb9d2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.150039] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.241862] env[65992]: INFO networking_nsxv3.common.synchronization [req-e06a055d-a55b-4417-bbcd-4cfa159632dc req-bfa19b55-6156-45ba-bc60-d439a128e460 tempest-ServerTagsTestJSON-958496922 tempest-ServerTagsTestJSON-958496922-project-member] Enqueued Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGHEST for action security_group_members [ 771.242464] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGHEST for action security_group_members [ 771.243607] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.243607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.244589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.244923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.245468] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.246142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.246218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.246400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.246483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.246582] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.512022] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7e4325-0a58-45b0-b4d0-e088a125232f in Status: SUCCESS [ 771.512022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.512022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.512022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.512022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.512022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.512022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.512022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.512022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.512022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.512022] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.655724] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.655724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.655724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.655724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.655724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.655724] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 is going to be created. [ 771.681162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.681284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.681325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.683379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.683379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.693554] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d5bb7968-a83f-4abf-8b92-43e75283178c None None] Enqueued Resource ID: 9a2df198-6c92-4f9a-a939-e6fda87573fb with Priority: HIGHEST for action port [ 771.694306] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2df198-6c92-4f9a-a939-e6fda87573fb with Priority: HIGHEST for action port [ 771.694733] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a2df198-6c92-4f9a-a939-e6fda87573fb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.694733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a2df198-6c92-4f9a-a939-e6fda87573fb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.695518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a2df198-6c92-4f9a-a939-e6fda87573fb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.695655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a2df198-6c92-4f9a-a939-e6fda87573fb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.695727] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a2df198-6c92-4f9a-a939-e6fda87573fb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.698905] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 in Status: UNINITIALIZED for 2s [ 771.753891] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.754094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.754137] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.754642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.754642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.754943] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.755200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.755200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.756864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.756864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.756864] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 already deleted. [ 771.756864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.800426] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.800426] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.800426] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.801489] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.801842] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.802020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.802147] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.802837] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.803292] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.803403] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.803576] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.803645] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.803748] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.803879] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.803987] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.804147] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.827320] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.827320] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.827320] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.827532] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.827851] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-51c501ae-7aa4-4450-ac58-348f46fb524e taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.828263] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-51c501ae-7aa4-4450-ac58-348f46fb524e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.828405] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-51c501ae-7aa4-4450-ac58-348f46fb524e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.828814] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-51c501ae-7aa4-4450-ac58-348f46fb524e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.829033] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51c501ae-7aa4-4450-ac58-348f46fb524e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.016600] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.016758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.016817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.017738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.017738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.017738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.017738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.017738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.017738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.017738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.018288] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.018288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.018288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.018288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.018413] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.018469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.018524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.018659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.018742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.018834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.019011] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.201103] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a2df198-6c92-4f9a-a939-e6fda87573fb [ 772.201103] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.202248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.202248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.202248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.202248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.202248] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a2df198-6c92-4f9a-a939-e6fda87573fb already deleted. [ 772.202248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a2df198-6c92-4f9a-a939-e6fda87573fb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.331812] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.332257] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.332601] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.332993] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.333286] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.333464] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 51c501ae-7aa4-4450-ac58-348f46fb524e not found, creating... [ 772.334103] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.334326] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.334475] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.334792] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.335035] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.335318] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.335566] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.335685] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.335913] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.336401] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.336401] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 51c501ae-7aa4-4450-ac58-348f46fb524e is going to be created. [ 772.365441] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.365807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.366119] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.366537] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.366853] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.366996] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-51c501ae-7aa4-4450-ac58-348f46fb524e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.521366] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe7e4325-0a58-45b0-b4d0-e088a125232f: rpc.has_security_group_logging(os_id): False [ 772.540635] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.540847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.540941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.541251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.541374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.541637] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.541777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.541874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.542087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.542195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.542454] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.542582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.542666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.542852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.542954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.543379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.544428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.544428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.544428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.544428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.544428] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe7e4325-0a58-45b0-b4d0-e088a125232f is going to be created. [ 772.618542] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.618821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.618887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.619157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.619391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.634430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7e4325-0a58-45b0-b4d0-e088a125232f in Status: IN_PROGRESS for 2s [ 773.130932] env[65992]: INFO networking_nsxv3.common.synchronization [req-e06a055d-a55b-4417-bbcd-4cfa159632dc req-9fa7909d-8c20-4f29-8aab-ffc0aef639e3 service nova] Enqueued Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGHEST for action security_group_rules [ 773.131212] env[65992]: INFO networking_nsxv3.common.synchronization [req-e06a055d-a55b-4417-bbcd-4cfa159632dc req-9fa7909d-8c20-4f29-8aab-ffc0aef639e3 service nova] Enqueued Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGHEST for action security_group_members [ 773.131298] env[65992]: INFO networking_nsxv3.common.synchronization [req-e06a055d-a55b-4417-bbcd-4cfa159632dc req-9fa7909d-8c20-4f29-8aab-ffc0aef639e3 service nova] Enqueued Resource ID: 51c501ae-7aa4-4450-ac58-348f46fb524e with Priority: HIGHEST for action port [ 773.131819] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGHEST for action security_group_rules [ 773.131929] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGHEST for action security_group_members [ 773.132038] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51c501ae-7aa4-4450-ac58-348f46fb524e with Priority: HIGHEST for action port [ 773.132414] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.132536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.132594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.132836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.132961] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.134083] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.134261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.134337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.134502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.134656] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.134753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.134814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.134988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.135089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.135183] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.138035] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-51c501ae-7aa4-4450-ac58-348f46fb524e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.138035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51c501ae-7aa4-4450-ac58-348f46fb524e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.138035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51c501ae-7aa4-4450-ac58-348f46fb524e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.138035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51c501ae-7aa4-4450-ac58-348f46fb524e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.138035] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51c501ae-7aa4-4450-ac58-348f46fb524e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.641916] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.641916] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.642919] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.642919] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51c501ae-7aa4-4450-ac58-348f46fb524e with status ACTIVE [ 773.643300] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.643300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.643300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.643623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.643715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.644176] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.644176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.644280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.644715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.644715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.644910] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.645069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.645226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.645454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.645542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.645654] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51c501ae-7aa4-4450-ac58-348f46fb524e is going to be updated. [ 773.671329] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.671474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.671614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.671795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.671941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.672180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51c501ae-7aa4-4450-ac58-348f46fb524e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.710807] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 in Status: SUCCESS [ 773.711106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.711968] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.712244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.712551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.712930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.713054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.713310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.713425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.713547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.713672] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.137186] env[65992]: INFO networking_nsxv3.common.synchronization [req-a5bf6a60-d5fb-423a-9ae8-00561378c2b2 req-a316c122-12a0-48fd-a264-dc8d18a4580c tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 774.137186] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 774.137186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.138626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.138904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.140290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.142318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.142318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.142318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.142318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.142318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.142318] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.149416] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.217235] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.638067] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.638067] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.638067] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.639451] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.639451] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.639451] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.639451] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.639451] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.639784] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.640109] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.640289] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.640478] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.640634] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.640796] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.640983] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.642495] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.645163] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.645163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.645258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.645389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.646887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.648164] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.648342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.648450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.648698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.648827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.648966] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 already deleted. [ 774.649135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.650232] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7e4325-0a58-45b0-b4d0-e088a125232f in Status: SUCCESS [ 774.650475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.651732] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.651955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.652166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.652810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.652810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.652810] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 is going to be created. [ 774.675093] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.675093] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 774.675093] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.675093] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.675093] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-3c677711-b405-4b80-b050-692db38b8c9f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.675093] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-3c677711-b405-4b80-b050-692db38b8c9f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.675093] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-3c677711-b405-4b80-b050-692db38b8c9f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.675670] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-3c677711-b405-4b80-b050-692db38b8c9f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.675851] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c677711-b405-4b80-b050-692db38b8c9f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.682456] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.682673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.682777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.683232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.683232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.696060] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 in Status: UNINITIALIZED for 2s [ 774.721776] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23: rpc.has_security_group_logging(os_id): False [ 774.742486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.742486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.742669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.742895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.742985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.743256] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.743371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.743453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.746451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.746558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.746658] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 is going to be created. [ 774.807092] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.807442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.807442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.807709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.808188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.822458] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 in Status: IN_PROGRESS for 2s [ 775.075389] env[65992]: INFO networking_nsxv3.common.synchronization [None req-a79620a8-4cc4-4688-b03b-470b3a4bffea None None] Enqueued Resource ID: b9beb006-ae81-4ec7-aea3-de2a3b468770 with Priority: HIGHEST for action port [ 775.075560] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9beb006-ae81-4ec7-aea3-de2a3b468770 with Priority: HIGHEST for action port [ 775.076078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9beb006-ae81-4ec7-aea3-de2a3b468770 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.076078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9beb006-ae81-4ec7-aea3-de2a3b468770" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.076338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9beb006-ae81-4ec7-aea3-de2a3b468770" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.076634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9beb006-ae81-4ec7-aea3-de2a3b468770" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.076726] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9beb006-ae81-4ec7-aea3-de2a3b468770',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.184080] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.184080] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.184080] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.184080] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.184080] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.184080] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 3c677711-b405-4b80-b050-692db38b8c9f not found, creating... [ 775.184080] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.184080] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.184080] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.184080] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.184080] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.184832] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.184832] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.185168] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.185861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.185861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.186111] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 3c677711-b405-4b80-b050-692db38b8c9f is going to be created. [ 775.213076] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.213076] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.213076] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.213076] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.213076] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.213076] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-3c677711-b405-4b80-b050-692db38b8c9f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.579306] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9beb006-ae81-4ec7-aea3-de2a3b468770 [ 775.579628] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.579809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.579902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.580206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.580341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.580531] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9beb006-ae81-4ec7-aea3-de2a3b468770 already deleted. [ 775.580624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9beb006-ae81-4ec7-aea3-de2a3b468770" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.985903] env[65992]: INFO networking_nsxv3.common.synchronization [req-a5bf6a60-d5fb-423a-9ae8-00561378c2b2 req-098a622e-5e09-412c-902a-d3eaa09243d5 service nova] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 775.986071] env[65992]: INFO networking_nsxv3.common.synchronization [req-a5bf6a60-d5fb-423a-9ae8-00561378c2b2 req-098a622e-5e09-412c-902a-d3eaa09243d5 service nova] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 775.986116] env[65992]: INFO networking_nsxv3.common.synchronization [req-a5bf6a60-d5fb-423a-9ae8-00561378c2b2 req-098a622e-5e09-412c-902a-d3eaa09243d5 service nova] Enqueued Resource ID: 3c677711-b405-4b80-b050-692db38b8c9f with Priority: HIGHEST for action port [ 775.986652] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 775.987151] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 775.987151] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c677711-b405-4b80-b050-692db38b8c9f with Priority: HIGHEST for action port [ 775.987332] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.987482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.987542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.988094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.988094] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.989043] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.989337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.989337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.989515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.989670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.989771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.989849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.990114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.990114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.990580] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.991169] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c677711-b405-4b80-b050-692db38b8c9f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.991290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c677711-b405-4b80-b050-692db38b8c9f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.991352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c677711-b405-4b80-b050-692db38b8c9f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.991520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c677711-b405-4b80-b050-692db38b8c9f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.991590] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c677711-b405-4b80-b050-692db38b8c9f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.494018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.494457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.494669] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.495640] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c677711-b405-4b80-b050-692db38b8c9f with status ACTIVE [ 776.495964] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.496168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.496255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.496477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.496596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.498384] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.498384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.498493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.498645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.498803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.498989] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.499051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.499144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.499321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.499404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.499490] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c677711-b405-4b80-b050-692db38b8c9f is going to be updated. [ 776.521795] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.521875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.521918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.522150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.522306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.522503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c677711-b405-4b80-b050-692db38b8c9f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.708304] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 in Status: SUCCESS [ 776.708304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.708304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.708304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.708498] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.708498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.708498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.708653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.708705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.708788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.708879] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.838767] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 in Status: SUCCESS [ 776.839000] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.003517] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.083997] env[65992]: INFO networking_nsxv3.common.synchronization [req-c896fb11-cf25-4bef-8de7-632760aa3279 req-2725faf9-dde4-439a-a078-6738eac86f93 tempest-ServerMetadataTestJSON-592403218 tempest-ServerMetadataTestJSON-592403218-project-member] Enqueued Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGHEST for action security_group_members [ 777.084788] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGHEST for action security_group_members [ 777.085450] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4846c43f-6807-48c3-8d2a-ba94d8295f7f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.085699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.085847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.086139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.086401] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.086610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.086748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.086988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.090243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.090409] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.219950] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.220145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.220219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.220463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.221246] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.221246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.221246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.221246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.221246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.221246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.221568] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.221568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.221568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.221568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.221689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.222056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.222056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.222056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.222309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.222309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.222309] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.508396] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.508760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.512280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.512660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.512891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.513176] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be created. [ 777.547607] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.547607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.547607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.551458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.551458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.563056] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: UNINITIALIZED for 2s [ 777.592772] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.592931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.593016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.593242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.593359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.593572] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.593685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.593729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.593880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.593953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.594055] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f is going to be updated. [ 777.641661] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.641661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.641661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.641661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.641860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.654544] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f in Status: IN_PROGRESS for 2s [ 777.725010] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fe1c430-86c0-4a40-8a1c-596f267de734: rpc.has_security_group_logging(os_id): False [ 777.747674] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.747860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.747957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.748322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.748452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.748708] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.748840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.748907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.749216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.749519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.749807] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.749943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.750108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.750188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.750265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.750535] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.750672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.750672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.750893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.751033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.751033] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 is going to be created. [ 777.827645] env[65992]: INFO networking_nsxv3.common.synchronization [None req-247409a9-7007-454e-b955-28d82d46f985 None None] Enqueued Resource ID: e93e79f6-2ecc-4a14-b6bb-c35deba56c6d with Priority: HIGHEST for action port [ 777.829801] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e93e79f6-2ecc-4a14-b6bb-c35deba56c6d with Priority: HIGHEST for action port [ 777.829801] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e93e79f6-2ecc-4a14-b6bb-c35deba56c6d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.829801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e93e79f6-2ecc-4a14-b6bb-c35deba56c6d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.829801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e93e79f6-2ecc-4a14-b6bb-c35deba56c6d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.829801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e93e79f6-2ecc-4a14-b6bb-c35deba56c6d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.829801] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e93e79f6-2ecc-4a14-b6bb-c35deba56c6d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.844407] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.844609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.844852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.844928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.845233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.860074] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 in Status: IN_PROGRESS for 2s [ 778.333273] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e93e79f6-2ecc-4a14-b6bb-c35deba56c6d [ 778.333434] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.333664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.333747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.334089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.334183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.334339] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e93e79f6-2ecc-4a14-b6bb-c35deba56c6d already deleted. [ 778.334339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e93e79f6-2ecc-4a14-b6bb-c35deba56c6d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.192571] env[65992]: INFO networking_nsxv3.common.synchronization [req-545eaa77-b96c-442e-b626-ef5ac44ba591 req-39312bb2-4e66-4b0d-92a5-bc428c139f66 tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 779.193691] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 779.193973] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.194173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.194264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.194648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.194780] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.195215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.195215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.195366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.195437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.195538] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.573966] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 779.574240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.574444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.574695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.574907] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.575073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.575167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.575351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.575449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.576012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.576634] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.580126] env[65992]: INFO networking_nsxv3.common.synchronization [req-3e69120c-9615-4546-bbaa-e4935d2031be req-c07b6140-4e5e-41fe-891d-d5d8472b29eb tempest-ListServerFiltersTestJSON-1509451299 tempest-ListServerFiltersTestJSON-1509451299-project-member] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 779.580796] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 779.581092] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.581241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.581319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.581514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.581744] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.581814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.581873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.582347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.582347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.582847] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.665697] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f in Status: SUCCESS [ 779.665913] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f deletion is rescheduled due to dependency. [ 779.666068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.668413] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.668840] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.668840] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.669136] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.669337] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.669766] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.669766] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.669866] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.669932] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.670164] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.670247] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.670352] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.670645] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.670645] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.670753] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.670795] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.693772] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.693772] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 779.693772] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.693772] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.693772] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-9bd371e9-1044-4abf-8c70-6b99b904f632 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.693772] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-9bd371e9-1044-4abf-8c70-6b99b904f632" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.693772] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-9bd371e9-1044-4abf-8c70-6b99b904f632" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.694083] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-9bd371e9-1044-4abf-8c70-6b99b904f632" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.694113] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd371e9-1044-4abf-8c70-6b99b904f632',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.698723] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.698860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.698960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.699216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.699302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.699517] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.699618] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.699672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.699818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.700050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.700050] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 779.727373] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.727521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.727591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.727794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.727930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.744280] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 779.881285] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 in Status: SUCCESS [ 779.881285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.059963] env[65992]: INFO networking_nsxv3.common.synchronization [req-a2e5e5be-54d5-4381-b5ae-61e380e7cd2a req-c6d6b5a5-99ec-47f6-90fe-62429acc103c tempest-ListImageFiltersTestJSON-580190969 tempest-ListImageFiltersTestJSON-580190969-project-member] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 780.060597] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 780.060950] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.061107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.061226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.061493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.061701] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.061852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.061950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.062153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.062291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.062460] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.079103] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.086024] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.198057] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.198457] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.198457] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.198687] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.198831] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.198984] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 9bd371e9-1044-4abf-8c70-6b99b904f632 not found, creating... [ 780.199294] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.199447] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.199562] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.199786] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.199956] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.200224] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.200407] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.200478] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.200680] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.200812] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.200949] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 9bd371e9-1044-4abf-8c70-6b99b904f632 is going to be created. [ 780.225011] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.225355] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.225492] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.225778] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.226032] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.226285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-9bd371e9-1044-4abf-8c70-6b99b904f632" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.565274] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.582225] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92df56c0-4890-4336-9656-3c0ad1e3b068: rpc.has_security_group_logging(os_id): False [ 780.588615] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.603515] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.603753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.603753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.604088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.604186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.604467] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.604606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.604661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.604896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.604992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.605103] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be created. [ 780.634738] env[65992]: INFO networking_nsxv3.common.synchronization [req-fb3c961c-3a6e-4fe1-ac39-de4d319de639 req-6802af87-831c-4a5c-9f9f-21a32859d4ed tempest-ImagesOneServerTestJSON-735956263 tempest-ImagesOneServerTestJSON-735956263-project-member] Enqueued Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGHEST for action security_group_members [ 780.636035] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGHEST for action security_group_members [ 780.636035] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-469d7145-af55-48eb-8111-6e095de38d66 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.636035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.636035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.636035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.637273] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.637273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.637273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.637273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.637273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.637273] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.672434] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.674102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.674102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.674102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.674102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.695947] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 780.953691] env[65992]: INFO networking_nsxv3.common.synchronization [req-545eaa77-b96c-442e-b626-ef5ac44ba591 req-cdba2015-bab8-47a5-a42d-fa027c9191fb service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 780.953933] env[65992]: INFO networking_nsxv3.common.synchronization [req-545eaa77-b96c-442e-b626-ef5ac44ba591 req-cdba2015-bab8-47a5-a42d-fa027c9191fb service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 780.954100] env[65992]: INFO networking_nsxv3.common.synchronization [req-545eaa77-b96c-442e-b626-ef5ac44ba591 req-cdba2015-bab8-47a5-a42d-fa027c9191fb service nova] Enqueued Resource ID: 9bd371e9-1044-4abf-8c70-6b99b904f632 with Priority: HIGHEST for action port [ 780.954661] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 780.954813] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 780.954909] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd371e9-1044-4abf-8c70-6b99b904f632 with Priority: HIGHEST for action port [ 780.955810] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.956172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.956307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.956582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.956758] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.960380] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.960571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.962360] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bd371e9-1044-4abf-8c70-6b99b904f632 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.962576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bd371e9-1044-4abf-8c70-6b99b904f632" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.962728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bd371e9-1044-4abf-8c70-6b99b904f632" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.964478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bd371e9-1044-4abf-8c70-6b99b904f632" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.964478] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd371e9-1044-4abf-8c70-6b99b904f632',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.068190] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.093038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.093038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.093038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.093038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.093038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.093038] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 781.130602] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.130809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.130907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.131163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.131343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.139396] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.140656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.140656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.140656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.140656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.140656] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.140656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.140949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.140949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.140949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.141058] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 469d7145-af55-48eb-8111-6e095de38d66 is going to be updated. [ 781.143342] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 781.175036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.175036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.175036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.175036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.175306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.186414] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 469d7145-af55-48eb-8111-6e095de38d66 in Status: IN_PROGRESS for 2s [ 781.467709] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.468107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.468107] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bd371e9-1044-4abf-8c70-6b99b904f632 with status ACTIVE [ 781.468372] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.468372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.468546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.468674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.468765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.468951] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.469068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.469136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.469311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.469387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.469580] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.469673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.469732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.469867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.469936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.470030] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bd371e9-1044-4abf-8c70-6b99b904f632 is going to be updated. [ 781.505078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.505078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.505078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.505078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.505078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.505078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bd371e9-1044-4abf-8c70-6b99b904f632" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.574450] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.574450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.574450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.574450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.574450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.574450] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be updated. [ 781.626976] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.626976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.626976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.626976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.626976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.635435] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: IN_PROGRESS for 2s [ 781.755272] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 781.755272] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 781.755421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.755549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.755760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.755942] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.756528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.756528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.756528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.756528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.756768] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.978173] env[65992]: INFO networking_nsxv3.common.synchronization [req-696adc3e-e957-4d89-8ee9-097b39528376 req-6f4c716f-d640-4cb4-9e4c-95e3bfb47267 tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 781.978173] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 781.978173] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.978784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.978872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.979215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.979444] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.979584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.979668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.979867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.979980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.980231] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.251181] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.251366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.251434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.251649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.251762] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.258845] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.445044] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.445044] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.445044] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.445044] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.445044] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.445044] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.445044] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.445044] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.445044] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.445044] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.445044] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.445584] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.445854] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.446153] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.446386] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.446651] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.469273] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.469616] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.469616] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.469722] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.470054] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-4d68e803-63d6-47ae-9124-0efc1196f73c taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.470230] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-4d68e803-63d6-47ae-9124-0efc1196f73c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.470357] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-4d68e803-63d6-47ae-9124-0efc1196f73c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.470705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-4d68e803-63d6-47ae-9124-0efc1196f73c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.470932] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d68e803-63d6-47ae-9124-0efc1196f73c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.483255] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.483399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.483484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.483722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.483776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.483933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.484121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.484121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.484218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.485540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.485540] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 782.514959] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.515226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.515323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.515538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.515687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.525824] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 782.710755] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 782.710755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.753694] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.761675] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.974205] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.974493] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.974647] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.974936] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.975112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.975272] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 4d68e803-63d6-47ae-9124-0efc1196f73c not found, creating... [ 782.975535] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.975684] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.975802] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.976102] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.976278] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.976456] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.976595] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.976713] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.976906] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.977063] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.977215] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 4d68e803-63d6-47ae-9124-0efc1196f73c is going to be created. [ 783.002009] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.002252] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.002379] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.002772] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.003172] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.003417] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-4d68e803-63d6-47ae-9124-0efc1196f73c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.156249] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 783.156351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.220189] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 469d7145-af55-48eb-8111-6e095de38d66 in Status: SUCCESS [ 783.220405] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 469d7145-af55-48eb-8111-6e095de38d66 deletion is rescheduled due to dependency. [ 783.220517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.257101] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.263579] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.264011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.264108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.264432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.264557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.264670] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 783.323706] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.324169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.324169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.324169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.324329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.339853] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 783.648120] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: SUCCESS [ 783.648566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.700819] env[65992]: INFO networking_nsxv3.common.synchronization [req-696adc3e-e957-4d89-8ee9-097b39528376 req-977ef764-5425-464c-ad3e-a0023fc540d4 service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 783.700819] env[65992]: INFO networking_nsxv3.common.synchronization [req-696adc3e-e957-4d89-8ee9-097b39528376 req-977ef764-5425-464c-ad3e-a0023fc540d4 service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 783.700819] env[65992]: INFO networking_nsxv3.common.synchronization [req-696adc3e-e957-4d89-8ee9-097b39528376 req-977ef764-5425-464c-ad3e-a0023fc540d4 service nova] Enqueued Resource ID: 4d68e803-63d6-47ae-9124-0efc1196f73c with Priority: HIGHEST for action port [ 783.701080] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 783.701119] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 783.701253] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d68e803-63d6-47ae-9124-0efc1196f73c with Priority: HIGHEST for action port [ 783.701485] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.701600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.701780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.702059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.702173] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.703018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.703184] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.704142] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d68e803-63d6-47ae-9124-0efc1196f73c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.704142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d68e803-63d6-47ae-9124-0efc1196f73c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.704142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d68e803-63d6-47ae-9124-0efc1196f73c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.704142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d68e803-63d6-47ae-9124-0efc1196f73c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.704142] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d68e803-63d6-47ae-9124-0efc1196f73c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.761598] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 783.761598] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 784.205408] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.205576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.205810] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d68e803-63d6-47ae-9124-0efc1196f73c with status ACTIVE [ 784.208052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.208052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.208052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.208052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.208995] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d68e803-63d6-47ae-9124-0efc1196f73c is going to be updated. [ 784.237633] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.237633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.237633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.237878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.237911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.238113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d68e803-63d6-47ae-9124-0efc1196f73c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.549190] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 784.549332] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a deletion is rescheduled due to dependency. [ 784.549447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.549612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.549815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.549993] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.550193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.550225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.550386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.550428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.550522] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.714460] env[65992]: INFO networking_nsxv3.common.synchronization [req-1886fd69-2a48-453c-b767-854dc1890fd1 req-53209c0c-736f-4c35-91a7-e72e6133ac2f tempest-ServersNegativeTestJSON-1286688584 tempest-ServersNegativeTestJSON-1286688584-project-member] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 784.715018] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 784.715528] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.716386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.716386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.716386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.716386] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.716386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.716386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.716795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.716795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.716795] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.844517] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.844737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.844841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.844985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.858559] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 784.859586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.860614] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 784.893230] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.893477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.893593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.893783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.900301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.900908] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 784.900992] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 784.901088] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 784.943667] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.943870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.943928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.944264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.945758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.946088] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 785.024571] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.024764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.024830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.025092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.025351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.025730] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 785.052561] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.092084] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.093467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.093467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.093467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.093467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.093684] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 785.093775] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2fe1c430-86c0-4a40-8a1c-596f267de734', '86094f9a-f281-4ae9-afd9-486fd3324728', '58a9088b-471e-48ab-8bf1-877d11c93872', '5b1651ec-9ca7-4bf6-866b-28fade5b94c5', '58879f8e-8e07-40c8-a0c9-63ab056f38ce', '67682f49-bbb6-48c3-b395-881a8117b7ac', 'c05766df-1b14-44a9-aa91-735a92b6816e', '6866765e-0cdc-4d35-aa21-1b0f99339ef0', 'df0ad3c9-7e54-40f4-a88a-89bc030489f8', '4846c43f-6807-48c3-8d2a-ba94d8295f7f', '8dbe3c7f-5b13-4659-b2e7-18c87792b278', 'fdc7601c-fb13-4bed-8af5-454bff4da6cf', 'fe7e4325-0a58-45b0-b4d0-e088a125232f', 'ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20', '76f6dffd-94d6-4a01-8082-da146608e51f', '0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b', 'c5ce6400-2109-4c84-b2da-30e330c81a70', 'ffb03a45-85bd-476b-b6c0-c61a67ecca90', '0d26e35f-7f74-471f-aa86-2ea84a3690b8', '469d7145-af55-48eb-8111-6e095de38d66', 'ac3fb6b8-5af1-492f-992f-9183de28faa7', '308a2531-7733-489b-8a70-8bf49437f735', '246ce419-a7b7-4e23-8bd8-c4c071ac447a', '06f48e26-5b6b-4a62-b58e-5e3abec6c0c9', 'ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23', '7883ea2f-8e33-46ff-9d56-25973809f24b', 'f8f9dacc-af29-4b40-93c8-17d4f636d125', '99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7', '436e4ee0-1cae-4512-b766-d84853476f90', '8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6', '92df56c0-4890-4336-9656-3c0ad1e3b068', '4fca3990-1a47-43bc-b0dc-d0194335893d', 'b14e2cad-daae-4705-9dc6-6e9de8cef89f', 'aa8c9176-c0d4-4732-93ba-a80e6182488b', '34a7c14c-af0d-4c42-abda-f1b7e2eebf3c', 'aafaab8c-0f8b-4ded-b666-286994920d39'} {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.093876] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 785.116553] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.116553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.116553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.116792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.117858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.119187] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 785.119335] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.119427] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 785.187732] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.187976] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.188195] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.188411] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.188706] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.188862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.188971] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.189740] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.189829] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.190053] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.190163] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.190265] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.190364] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.190459] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.190577] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.190719] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.199252] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.199252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.199414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.202980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.202980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.202980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 785.202980] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.202980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 785.202980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 785.202980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGH for action security_group_rules [ 785.202980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.219810] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.236042] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.236042] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.236042] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.236042] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.236042] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-bb086972-0345-40ee-ad56-2eadcc53e8e7 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.236042] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-bb086972-0345-40ee-ad56-2eadcc53e8e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.237395] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-bb086972-0345-40ee-ad56-2eadcc53e8e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.237862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-bb086972-0345-40ee-ad56-2eadcc53e8e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.238118] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb086972-0345-40ee-ad56-2eadcc53e8e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.352338] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 785.352736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.352922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.353397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.353528] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.353659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.353758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.353969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.354062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.354158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.354268] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.555347] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.719333] env[65992]: INFO networking_nsxv3.common.synchronization [None req-5fb1cc82-15d7-4307-88af-c22c1929bb11 None None] Enqueued Resource ID: f12cb580-86d3-47e0-8222-e821dbe1b5cf with Priority: HIGHEST for action port [ 785.720079] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12cb580-86d3-47e0-8222-e821dbe1b5cf with Priority: HIGHEST for action port [ 785.720254] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGH for action security_group_rules [ 785.720359] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGH for action security_group_rules [ 785.720461] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05766df-1b14-44a9-aa91-735a92b6816e with Priority: HIGH for action security_group_rules [ 785.720558] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f6dffd-94d6-4a01-8082-da146608e51f with Priority: HIGH for action security_group_rules [ 785.720652] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 469d7145-af55-48eb-8111-6e095de38d66 with Priority: HIGH for action security_group_rules [ 785.720745] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGH for action security_group_rules [ 785.720834] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 with Priority: HIGH for action security_group_rules [ 785.720924] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5ce6400-2109-4c84-b2da-30e330c81a70 with Priority: HIGH for action security_group_rules [ 785.721018] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 with Priority: HIGH for action security_group_rules [ 785.721116] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b with Priority: HIGH for action security_group_rules [ 785.721207] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGH for action security_group_rules [ 785.721295] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGH for action security_group_rules [ 785.721407] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGH for action security_group_rules [ 785.721504] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f with Priority: HIGH for action security_group_rules [ 785.721602] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 with Priority: HIGH for action security_group_rules [ 785.721687] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67682f49-bbb6-48c3-b395-881a8117b7ac with Priority: HIGH for action security_group_rules [ 785.721771] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGH for action security_group_rules [ 785.721853] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGH for action security_group_rules [ 785.721934] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86094f9a-f281-4ae9-afd9-486fd3324728 with Priority: HIGH for action security_group_rules [ 785.722039] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGH for action security_group_rules [ 785.722452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f12cb580-86d3-47e0-8222-e821dbe1b5cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.722523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f12cb580-86d3-47e0-8222-e821dbe1b5cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.722585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f12cb580-86d3-47e0-8222-e821dbe1b5cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.722922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f12cb580-86d3-47e0-8222-e821dbe1b5cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.722995] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f12cb580-86d3-47e0-8222-e821dbe1b5cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.724611] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.724611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.724611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.724611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.724922] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.726330] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.726488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.726555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.726724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.726799] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.727768] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c05766df-1b14-44a9-aa91-735a92b6816e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.727768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.727768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.727943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.727981] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c05766df-1b14-44a9-aa91-735a92b6816e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.729256] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76f6dffd-94d6-4a01-8082-da146608e51f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.729383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.729748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.729914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.729989] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76f6dffd-94d6-4a01-8082-da146608e51f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.731164] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-469d7145-af55-48eb-8111-6e095de38d66 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.731255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.731292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.731489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.731560] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('469d7145-af55-48eb-8111-6e095de38d66',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.734376] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.734835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.734835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.734835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.734835] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.735126] env[65992]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 785.736625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.736730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.736789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.737035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.737035] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffb03a45-85bd-476b-b6c0-c61a67ecca90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.738836] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5ce6400-2109-4c84-b2da-30e330c81a70 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.738988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.739189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.739296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.739424] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5ce6400-2109-4c84-b2da-30e330c81a70',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.741189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.741318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.741358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.741682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.741682] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.744379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.744379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.744379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.744644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.744644] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.747355] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.750314] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.750496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.750552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.750720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.750800] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.753385] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.753385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.753577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.753612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.753699] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.754964] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.755093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.755161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.755351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.755428] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.756491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.756607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.756657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.756854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.756917] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4846c43f-6807-48c3-8d2a-ba94d8295f7f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.758182] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.758182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.758182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.758410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.758488] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df0ad3c9-7e54-40f4-a88a-89bc030489f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.759554] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67682f49-bbb6-48c3-b395-881a8117b7ac taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.759665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.759665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.759797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.759870] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67682f49-bbb6-48c3-b395-881a8117b7ac',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.760112] env[65992]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 785.760925] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.760925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.761442] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.761546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.761623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.761773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.761842] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.762931] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86094f9a-f281-4ae9-afd9-486fd3324728 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.762931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.763077] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.763152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.763225] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86094f9a-f281-4ae9-afd9-486fd3324728',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.764065] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.764170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.764234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.764381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.764552] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.769060] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f12cb580-86d3-47e0-8222-e821dbe1b5cf [ 785.769231] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.769320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.769359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.769641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.769710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.769749] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f12cb580-86d3-47e0-8222-e821dbe1b5cf already deleted. [ 785.769831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f12cb580-86d3-47e0-8222-e821dbe1b5cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.770866] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.770995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.771099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.771252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.771405] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.771500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.771567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.771696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.771772] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.771850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.771936] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.775225] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.775415] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.775533] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.775768] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.775937] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.776090] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port bb086972-0345-40ee-ad56-2eadcc53e8e7 not found, creating... [ 785.776351] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.776501] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.776608] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.776813] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.776966] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.777224] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.777368] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.777472] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.777664] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.777823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.777967] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: bb086972-0345-40ee-ad56-2eadcc53e8e7 is going to be created. [ 785.811662] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.811869] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.811989] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.812324] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.812918] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.813169] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-bb086972-0345-40ee-ad56-2eadcc53e8e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.857644] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.857855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.857923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.858570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.858756] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.858865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.858927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.859131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.859216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.859300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.859477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.859551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.859607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.859748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.859879] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.859966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.860041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.860173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.860250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.860361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.861079] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.057870] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.058778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.058778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.060775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.060775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.060775] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 786.103456] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.103735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.103735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.103993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.104074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.116114] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 786.268494] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.268494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.268720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.268783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.268933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.268999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.270513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.270513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.270513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.270513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.270513] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.283892] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.283892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.284496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.284496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.284496] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.284496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.284496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.284778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.284778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.284778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.284917] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.285017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.285092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.285235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.285374] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.285465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.285523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.285652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.285722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.285799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.285884] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.323268] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.323268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.323531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.323531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.323835] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.323835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.323969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.324057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.324108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.324170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.324353] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.325391] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.326394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.326394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.326394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.326394] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.326394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.326394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.326394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.326730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.326730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.326730] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.327470] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.327599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.327635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.327792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.330738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.330858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.330925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.331106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.331189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.332265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.332403] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.336672] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.336885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.336963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.338349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.338538] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.339772] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.339851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.340081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.340138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.340232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.340340] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.342866] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.343351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.343351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.343577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.343658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.343784] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be updated. [ 786.350459] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.350624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.350624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.350837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.355524] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.355657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.358315] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.358601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.358699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.359243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.359442] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.359559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.359630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.359818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.359911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.359999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.360102] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.362551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.362672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.362744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.362904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.363062] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.363452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.363452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.363974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.364119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.364221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.364308] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.376397] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6866765e-0cdc-4d35-aa21-1b0f99339ef0: rpc.has_security_group_logging(os_id): False [ 786.424037] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.424037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.424930] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.425083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.426038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.426176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.428185] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.428185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.428449] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.428683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.430978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.430978] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4846c43f-6807-48c3-8d2a-ba94d8295f7f is going to be deleted. [ 786.432498] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.432622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.432682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.432870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.437044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.437044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.437044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.437044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.437044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.437673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.437809] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.437892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.455954] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.455954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.455954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.455954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.455954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.466899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.466899] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20 is going to be deleted. [ 786.467232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.467455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.469281] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: IN_PROGRESS for 2s [ 786.501600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.501773] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b is going to be deleted. [ 786.502962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.504396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.534422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.534809] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67682f49-bbb6-48c3-b395-881a8117b7ac is going to be deleted. [ 786.535932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.536205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.584920] env[65992]: INFO networking_nsxv3.common.synchronization [req-1886fd69-2a48-453c-b767-854dc1890fd1 req-5934ab8f-7700-4b12-ac9e-b689a77c4247 service nova] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_rules [ 786.584920] env[65992]: INFO networking_nsxv3.common.synchronization [req-1886fd69-2a48-453c-b767-854dc1890fd1 req-5934ab8f-7700-4b12-ac9e-b689a77c4247 service nova] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 786.584920] env[65992]: INFO networking_nsxv3.common.synchronization [req-1886fd69-2a48-453c-b767-854dc1890fd1 req-5934ab8f-7700-4b12-ac9e-b689a77c4247 service nova] Enqueued Resource ID: bb086972-0345-40ee-ad56-2eadcc53e8e7 with Priority: HIGHEST for action port [ 786.584920] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_rules [ 786.584920] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 786.584920] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb086972-0345-40ee-ad56-2eadcc53e8e7 with Priority: HIGHEST for action port [ 786.584920] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.584920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.584920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.584920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.584920] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.587489] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.587489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.590814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb086972-0345-40ee-ad56-2eadcc53e8e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.590814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb086972-0345-40ee-ad56-2eadcc53e8e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.590814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb086972-0345-40ee-ad56-2eadcc53e8e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.590814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb086972-0345-40ee-ad56-2eadcc53e8e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.590814] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb086972-0345-40ee-ad56-2eadcc53e8e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.650145] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.650145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.652363] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.652363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.657295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.657446] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df0ad3c9-7e54-40f4-a88a-89bc030489f8 is going to be deleted. [ 786.658934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.659573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.714025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.714183] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 469d7145-af55-48eb-8111-6e095de38d66 is going to be deleted. [ 786.715188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.715410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.770182] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.770470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.772743] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.776673] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.776673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.789089] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fe1c430-86c0-4a40-8a1c-596f267de734: rpc.has_security_group_logging(os_id): False [ 786.828585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.828585] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5ce6400-2109-4c84-b2da-30e330c81a70 is going to be deleted. [ 786.830262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.831040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.833294] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.833516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.850152] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.850356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.850440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.850694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.850910] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.851016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.851108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.851290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.851411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.851508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.851690] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.851807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.851873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.852088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.852234] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.852336] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.852602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.852602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.852675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.852750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.854049] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.854901] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.855038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.855135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.855329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.855694] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.855694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.855694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.855858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.856084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.856084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.856253] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.856344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.856428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.856582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.856767] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.856844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.856897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.858392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.858560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.858643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.858759] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.860380] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.861683] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.862934] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.863067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.863134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.863333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.863496] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.863616] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.863655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.863791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.863880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.863972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.864132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.864228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.864283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.864481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.864658] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.864757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.864857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.864955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.865026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.865111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.865200] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.870996] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.880408] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.880711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.976340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.976495] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76f6dffd-94d6-4a01-8082-da146608e51f is going to be deleted. [ 786.978047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.978299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.063269] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.063269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.064017] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.064248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.078198] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 787.078198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.078198] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.078198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.078198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.078198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.078198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.078580] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.078580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.078580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.078765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.078806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.078982] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.079144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.079144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.079718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.079718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.079718] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 787.080640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.080811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.093383] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.093616] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.093693] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb086972-0345-40ee-ad56-2eadcc53e8e7 with status ACTIVE [ 787.093909] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.094128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.094128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.094299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.094341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.095170] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.095170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.095170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.095170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.095170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.095170] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.095170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.095170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.095612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.095612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.095612] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb086972-0345-40ee-ad56-2eadcc53e8e7 is going to be updated. [ 787.162364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.162515] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffb03a45-85bd-476b-b6c0-c61a67ecca90 is going to be deleted. [ 787.163584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.163809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.165079] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.165201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.165237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.165397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.165526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.165740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb086972-0345-40ee-ad56-2eadcc53e8e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.276159] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58a9088b-471e-48ab-8bf1-877d11c93872: rpc.has_security_group_logging(os_id): False [ 787.298744] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.299124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.314427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.314556] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c05766df-1b14-44a9-aa91-735a92b6816e is going to be deleted. [ 787.315492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.315817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.315817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.315939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4846c43f-6807-48c3-8d2a-ba94d8295f7f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.316612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.316953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.316953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.317062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.361155] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdc7601c-fb13-4bed-8af5-454bff4da6cf: rpc.has_security_group_logging(os_id): False [ 787.363759] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8dbe3c7f-5b13-4659-b2e7-18c87792b278: rpc.has_security_group_logging(os_id): False [ 787.365059] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d26e35f-7f74-471f-aa86-2ea84a3690b8: rpc.has_security_group_logging(os_id): False [ 787.367197] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b1651ec-9ca7-4bf6-866b-28fade5b94c5: rpc.has_security_group_logging(os_id): False [ 787.367709] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe7e4325-0a58-45b0-b4d0-e088a125232f: rpc.has_security_group_logging(os_id): False [ 787.374474] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58879f8e-8e07-40c8-a0c9-63ab056f38ce: rpc.has_security_group_logging(os_id): False [ 787.404337] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.404463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.409880] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.411142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.424220] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.424345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.435391] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.435391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.437755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.437755] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.437755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.437755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.437755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.438437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.438628] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be updated. [ 787.439826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.440573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.440573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.440573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67682f49-bbb6-48c3-b395-881a8117b7ac" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.440573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.440748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.440748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.440878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e08fabd-7ba4-4d13-b6cf-4c3df6a89d4b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.442044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.442044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.442253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.442253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.443295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.444029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.444029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.444029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.444029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df0ad3c9-7e54-40f4-a88a-89bc030489f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.444029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.444029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.457568] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.457568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.461475] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.461606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.462451] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.462567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.523322] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 787.536456] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.536456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.544473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.544641] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.544762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.544821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.546063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.546063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.546063] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.546063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.546063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.546063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.546063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.546063] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.546063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.546063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.546921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.546921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.546921] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 is going to be updated. [ 787.547669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.548615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.713330] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86094f9a-f281-4ae9-afd9-486fd3324728 is going to be deleted. [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef5c2f1b-9cc8-4c46-aa22-5d1fdaac0e20" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.713330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffb03a45-85bd-476b-b6c0-c61a67ecca90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.714289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.714530] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.743932] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.744171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.798221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.798756] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.798756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.798756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.799044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.799162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.799448] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.799572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.799636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.799809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.799910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.800147] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.800206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.800424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.800594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.800594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.800720] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be updated. [ 787.801816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.801992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.822761] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.823098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.838097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.838348] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.838840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.838840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.838960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.838997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.839584] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be updated. [ 787.840496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.840727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.840847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.841060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-469d7145-af55-48eb-8111-6e095de38d66" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.841931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.841931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.841931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.841931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5ce6400-2109-4c84-b2da-30e330c81a70" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.841931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.842184] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.943933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.943933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.960934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.961243] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.961475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.961549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.961760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.961851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.961956] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 is going to be updated. [ 787.963156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.963408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.016240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.016908] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.016908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.016908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.016908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.017146] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.017264] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.017318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.017372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.017628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.017628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.017814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.017894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.017955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.018685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.018805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.018992] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe7e4325-0a58-45b0-b4d0-e088a125232f is going to be updated. [ 788.020715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.020960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.021175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.021329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76f6dffd-94d6-4a01-8082-da146608e51f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.021498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.021679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.021844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.023035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.023321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.091899] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: IN_PROGRESS for 2s [ 788.103383] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.103565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.109211] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.109403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.110621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.111482] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.111482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.111482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.111482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.111482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.111713] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.111835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.111908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.112113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.112899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.112899] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.112899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.112899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.113156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.113156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.113156] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be updated. [ 788.114245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.114710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.155603] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 788.155877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.156339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.156605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.157231] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.157231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.157403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.158132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.158132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.158132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.158132] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.186247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.186584] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.186695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.186763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.186962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.187059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.187167] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce is going to be updated. [ 788.188342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.188547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.188630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.188767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c05766df-1b14-44a9-aa91-735a92b6816e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.188901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.189244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.189399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.190832] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.191012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.191157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.192106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.192603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.192760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.194227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.194392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.194482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.194991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86094f9a-f281-4ae9-afd9-486fd3324728" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.204466] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.204807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.204905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.205418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.205750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.208606] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.208722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.208798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.209250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.209573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.242749] env[65992]: INFO networking_nsxv3.common.synchronization [None req-7abf11e3-951e-4659-99a7-6aaa2fafc28d None None] Enqueued Resource ID: 044db3ce-b3ec-463a-a17f-dfbeb6de8adb with Priority: HIGHEST for action port [ 788.243328] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044db3ce-b3ec-463a-a17f-dfbeb6de8adb with Priority: HIGHEST for action port [ 788.243670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-044db3ce-b3ec-463a-a17f-dfbeb6de8adb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.243767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-044db3ce-b3ec-463a-a17f-dfbeb6de8adb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.243815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-044db3ce-b3ec-463a-a17f-dfbeb6de8adb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.244545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-044db3ce-b3ec-463a-a17f-dfbeb6de8adb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.244613] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('044db3ce-b3ec-463a-a17f-dfbeb6de8adb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.263915] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 in Status: IN_PROGRESS for 2s [ 788.266916] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7e4325-0a58-45b0-b4d0-e088a125232f in Status: IN_PROGRESS for 2s [ 788.274694] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 in Status: IN_PROGRESS for 2s [ 788.277500] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: IN_PROGRESS for 2s [ 788.279422] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: IN_PROGRESS for 2s [ 788.328857] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.329100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.329100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.329624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.329624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.375562] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: IN_PROGRESS for 2s [ 788.395024] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 788.395024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.395024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.395024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.395024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.395024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.449941] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce in Status: IN_PROGRESS for 2s [ 788.483628] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 788.484554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.484554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.484785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.485449] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.485449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.485449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.485449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.485449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.486650] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.661159] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.661697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.661697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.661929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.662133] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.662267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.662342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.662516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.662603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.662705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.662880] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.662977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.663051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.663195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.663340] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.663436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.663490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.663604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.663680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.663760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.664263] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.751148] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 044db3ce-b3ec-463a-a17f-dfbeb6de8adb [ 788.751466] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.751607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.751689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.751894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.751991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.752103] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:044db3ce-b3ec-463a-a17f-dfbeb6de8adb already deleted. [ 788.752184] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-044db3ce-b3ec-463a-a17f-dfbeb6de8adb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.988939] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.166101] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 246ce419-a7b7-4e23-8bd8-c4c071ac447a: rpc.has_security_group_logging(os_id): False [ 789.191959] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.192173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.192254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.192500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.221985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.221985] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.221985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.221985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.221985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.221985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.222915] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.223558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.223558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.223796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.223953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.224419] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.224558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.224776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.225030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.225191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.225380] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 789.342666] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.342954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.342954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.344161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.344161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.362433] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 789.492666] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.539892] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 789.540166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.540411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.540675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.540761] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.003059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.003059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.003059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.003059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.003059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.003059] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be updated. [ 790.046489] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.046916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.047106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.047399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.047735] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.047952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.048163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.048899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.048899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.048899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.048899] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.052994] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.052994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.052994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.052994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.052994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.063795] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: IN_PROGRESS for 2s [ 790.109024] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 790.109024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.450234] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe7e4325-0a58-45b0-b4d0-e088a125232f in Status: SUCCESS [ 790.450482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.451588] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 in Status: SUCCESS [ 790.451794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.481870] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 in Status: SUCCESS [ 790.481870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.482314] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: SUCCESS [ 790.483946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.483946] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: SUCCESS [ 790.484193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.484959] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce in Status: SUCCESS [ 790.485255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.486163] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: SUCCESS [ 790.486259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.553939] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.554110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.554199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.554477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.554718] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.554784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.557019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.557019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.557019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.557019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.557019] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.557019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.557019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.557384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.557571] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.557668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.557727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.557878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.557950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.558039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.558216] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.060358] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6866765e-0cdc-4d35-aa21-1b0f99339ef0: rpc.has_security_group_logging(os_id): False [ 791.081323] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.081749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.081749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.081749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.081976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.082048] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.082156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.082156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.082399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.082399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.082647] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.082647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.082647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.082819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.082928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.083226] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.083226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.083226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.083507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.083507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.083507] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 791.148536] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.148707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.148841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.149075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.149221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.168080] env[65992]: INFO networking_nsxv3.common.synchronization [req-c84a86af-ae70-4b90-aa31-ba8a7207d5f8 req-74bd43d4-cd8d-49a4-a269-4ee9e6ab4496 tempest-ServersTestFqdnHostnames-1006644802 tempest-ServersTestFqdnHostnames-1006644802-project-member] Enqueued Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_members [ 791.169409] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 791.169791] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGHEST for action security_group_members [ 791.170168] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.170302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.170503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.170776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.171312] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.171312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.171312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.171312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.171517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.171584] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.379043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 791.379381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.674463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.674640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.674703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.674892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.674975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.675181] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.675277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.675344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.675524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.675612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.675789] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce is going to be updated. [ 791.706689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.706812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.706886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.707102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.707385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.718430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce in Status: IN_PROGRESS for 2s [ 792.076070] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 792.076070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.076070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.076591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.077204] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.077397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.077493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.077665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.077774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.077930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.077930] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.581079] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.581339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.581434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.581643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.581819] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.581932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.581999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.582143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.582224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.582303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.582475] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.582557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.582614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.583139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.583139] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.583139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.583139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.583621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.583621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.583621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.583621] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.086741] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6: rpc.has_security_group_logging(os_id): False [ 793.107021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.107183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.107300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.107619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.130345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.130468] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.130920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.130920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.130920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.131070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.131178] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.131275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.131332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.131502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.131543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.131744] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.131837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.131893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.132141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.132258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.132407] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be updated. [ 793.188464] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 793.188678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.208945] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.209349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.209422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.209611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.209771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.233026] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: IN_PROGRESS for 2s [ 793.730876] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce in Status: SUCCESS [ 793.731057] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce deletion is rescheduled due to dependency. [ 793.731174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.487994] env[65992]: INFO networking_nsxv3.common.synchronization [req-ff9ea2d4-a103-406e-b605-358818a6d674 req-d79153d9-3b3f-4991-9002-7fb578f8ece7 tempest-ServersAdminTestJSON-561694848 tempest-ServersAdminTestJSON-561694848-project-member] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 794.492024] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 794.492024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.492024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.492024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.492024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.492581] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.492581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.492581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.494100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.494218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.494391] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.999348] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.251167] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 795.251427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.459610] env[65992]: INFO networking_nsxv3.common.synchronization [req-de7e88b3-ec65-4017-86c4-b0cf3aa40d88 req-548ac358-3852-473f-a5a5-1327b0cbeee7 tempest-FloatingIPsAssociationTestJSON-1610940676 tempest-FloatingIPsAssociationTestJSON-1610940676-project-member] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 795.460219] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 795.460543] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.460660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.460729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.460905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.461179] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.461344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.461443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.461553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.461601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.461691] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.502871] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.965030] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.007621] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.007621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.007621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.007621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.007621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.007621] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 796.047031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.047031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.047031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.047031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.047031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.058957] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 796.219015] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.219524] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-712" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.219524] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-712" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.220094] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-712" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.220094] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.220094] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.220309] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.220524] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.220608] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.220868] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.220958] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.221086] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.221513] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.221513] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.221513] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.221513] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.242787] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.243645] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.243645] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.243645] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-712" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.244086] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-1a099974-785c-441d-8250-458bb58f24a6 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.244373] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-1a099974-785c-441d-8250-458bb58f24a6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.244590] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-1a099974-785c-441d-8250-458bb58f24a6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.245205] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-1a099974-785c-441d-8250-458bb58f24a6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.245446] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a099974-785c-441d-8250-458bb58f24a6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.467498] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.748769] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.749070] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.749140] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.749465] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.749593] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.749699] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 1a099974-785c-441d-8250-458bb58f24a6 not found, creating... [ 796.749971] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.750150] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.750267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.750490] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.750623] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.750933] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.751499] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.751499] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.751499] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.751499] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.751678] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 1a099974-785c-441d-8250-458bb58f24a6 is going to be created. [ 796.778336] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.778583] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.778657] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.779216] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.779216] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.779464] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-1a099974-785c-441d-8250-458bb58f24a6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.969534] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.969765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.969838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.970053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.970143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.970246] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be updated. [ 797.031189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.031408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.031486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.031770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.031967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.044528] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: IN_PROGRESS for 2s [ 797.108991] env[65992]: INFO networking_nsxv3.common.synchronization [None req-103b28f4-115e-49e3-a245-0b941979f99a None None] Enqueued Resource ID: 04639631-1d88-455c-a728-df8ab95b1611 with Priority: HIGHEST for action port [ 797.109638] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04639631-1d88-455c-a728-df8ab95b1611 with Priority: HIGHEST for action port [ 797.109982] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-04639631-1d88-455c-a728-df8ab95b1611 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.110139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04639631-1d88-455c-a728-df8ab95b1611" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.110205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04639631-1d88-455c-a728-df8ab95b1611" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.110542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04639631-1d88-455c-a728-df8ab95b1611" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.110622] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04639631-1d88-455c-a728-df8ab95b1611',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.555541] env[65992]: INFO networking_nsxv3.common.synchronization [req-de7e88b3-ec65-4017-86c4-b0cf3aa40d88 req-e07449a8-8514-4d2f-a3e2-278f8ef15c61 service nova] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_rules [ 797.555794] env[65992]: INFO networking_nsxv3.common.synchronization [req-de7e88b3-ec65-4017-86c4-b0cf3aa40d88 req-e07449a8-8514-4d2f-a3e2-278f8ef15c61 service nova] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 797.555870] env[65992]: INFO networking_nsxv3.common.synchronization [req-de7e88b3-ec65-4017-86c4-b0cf3aa40d88 req-e07449a8-8514-4d2f-a3e2-278f8ef15c61 service nova] Enqueued Resource ID: 1a099974-785c-441d-8250-458bb58f24a6 with Priority: HIGHEST for action port [ 797.556417] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_rules [ 797.556547] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 797.556640] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a099974-785c-441d-8250-458bb58f24a6 with Priority: HIGHEST for action port [ 797.558823] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.558984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.559062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.559331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.559420] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.562203] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.562203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.562203] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a099974-785c-441d-8250-458bb58f24a6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.562203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a099974-785c-441d-8250-458bb58f24a6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.562203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a099974-785c-441d-8250-458bb58f24a6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.562203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a099974-785c-441d-8250-458bb58f24a6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.562203] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a099974-785c-441d-8250-458bb58f24a6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.613577] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04639631-1d88-455c-a728-df8ab95b1611 [ 797.613822] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.613956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.614039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.614264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.614350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.614446] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04639631-1d88-455c-a728-df8ab95b1611 already deleted. [ 797.614522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04639631-1d88-455c-a728-df8ab95b1611" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.689381] env[65992]: INFO networking_nsxv3.common.synchronization [req-30af3b07-c65c-4c86-af6c-18adfcc1693e req-7700a459-e2c3-4f75-8b95-26ce7cd29cf6 tempest-FloatingIPsAssociationNegativeTestJSON-602498819 tempest-FloatingIPsAssociationNegativeTestJSON-602498819-project-member] Enqueued Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGHEST for action security_group_members [ 797.692769] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGHEST for action security_group_members [ 797.693586] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.693754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.693845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.694293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.694379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.694464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.694561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.695041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.695041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.695041] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.068132] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a099974-785c-441d-8250-458bb58f24a6 with status ACTIVE [ 798.068132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.068132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.068132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.068132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.068132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.068132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.068132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.068132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.068132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.068132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.069206] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.069206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.069206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.069206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.069206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.069206] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a099974-785c-441d-8250-458bb58f24a6 is going to be updated. [ 798.070016] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.072280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.075169] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 798.075169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.101597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.101745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.101826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.102039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.102174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.102477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a099974-785c-441d-8250-458bb58f24a6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.200699] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.200922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.200922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.202022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.202022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.202022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.202022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.202022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.202022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.202022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.202022] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7e4325-0a58-45b0-b4d0-e088a125232f is going to be updated. [ 798.228764] env[65992]: INFO networking_nsxv3.common.synchronization [req-b2702250-392b-4481-8f5d-ce4a17ae0d21 req-eb513114-dc75-49d6-a75d-bfd40d76e32f tempest-MigrationsAdminTest-1940019867 tempest-MigrationsAdminTest-1940019867-project-member] Enqueued Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 798.234540] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 798.234540] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.234540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.234540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.234540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.234540] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.236969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.236969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.236969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.236969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.236969] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.248743] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.248743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.248743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.248743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.248743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.263969] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7e4325-0a58-45b0-b4d0-e088a125232f in Status: IN_PROGRESS for 2s [ 798.708341] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.708538] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.708656] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.708919] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.709870] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.709870] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.709870] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.710093] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.710260] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.710875] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.711010] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.711445] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.711445] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.711445] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.711445] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.711693] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.732288] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.732467] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 798.732956] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.732956] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-390" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.733113] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.733290] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.733406] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.734249] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.734616] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca763b5-9a7f-4d95-beba-d0d5cbf77aea',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.739518] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.057506] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: SUCCESS [ 799.057506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.057506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.057506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.057506] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.057506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.057506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.057506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.057506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.057506] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.237165] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.237787] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.238354] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.241888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.241888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.241888] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port fca763b5-9a7f-4d95-beba-d0d5cbf77aea not found, creating... [ 799.241888] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.241888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.241888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.241888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.241888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.241888] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.241888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.242290] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.242290] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.242290] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.242529] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: fca763b5-9a7f-4d95-beba-d0d5cbf77aea is going to be created. [ 799.244627] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.271029] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.271029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.271029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.271029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.271029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.271029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.536823] env[65992]: INFO networking_nsxv3.common.synchronization [None req-dbb893f9-35c0-486c-95f7-6ba74278f7b6 None None] Enqueued Resource ID: a48077c9-4c73-4495-ae11-04172a1467d6 with Priority: HIGHEST for action port [ 799.537727] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a48077c9-4c73-4495-ae11-04172a1467d6 with Priority: HIGHEST for action port [ 799.538066] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a48077c9-4c73-4495-ae11-04172a1467d6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.538211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a48077c9-4c73-4495-ae11-04172a1467d6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.538288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a48077c9-4c73-4495-ae11-04172a1467d6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.538549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a48077c9-4c73-4495-ae11-04172a1467d6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.538625] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a48077c9-4c73-4495-ae11-04172a1467d6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.561406] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.751270] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.751270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.751270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.752572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.752842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.752978] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c is going to be updated. [ 799.788787] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.789036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.789495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.789677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.789719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.800993] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: IN_PROGRESS for 2s [ 800.041666] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a48077c9-4c73-4495-ae11-04172a1467d6 [ 800.041946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.042129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.042187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.042386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.042459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.042556] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a48077c9-4c73-4495-ae11-04172a1467d6 already deleted. [ 800.042637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a48077c9-4c73-4495-ae11-04172a1467d6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.053843] env[65992]: INFO networking_nsxv3.common.synchronization [req-b2702250-392b-4481-8f5d-ce4a17ae0d21 req-4962dda2-978c-465d-be94-0859e3616ddf service nova] Enqueued Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_rules [ 800.053843] env[65992]: INFO networking_nsxv3.common.synchronization [req-b2702250-392b-4481-8f5d-ce4a17ae0d21 req-4962dda2-978c-465d-be94-0859e3616ddf service nova] Enqueued Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 800.053843] env[65992]: INFO networking_nsxv3.common.synchronization [req-b2702250-392b-4481-8f5d-ce4a17ae0d21 req-4962dda2-978c-465d-be94-0859e3616ddf service nova] Enqueued Resource ID: fca763b5-9a7f-4d95-beba-d0d5cbf77aea with Priority: HIGHEST for action port [ 800.055087] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_rules [ 800.055087] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 800.055087] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca763b5-9a7f-4d95-beba-d0d5cbf77aea with Priority: HIGHEST for action port [ 800.055087] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.055087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.055087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.058403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.058403] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.058403] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.058403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.058403] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.058403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.058403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.058403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.058403] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca763b5-9a7f-4d95-beba-d0d5cbf77aea',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.064554] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.276216] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe7e4325-0a58-45b0-b4d0-e088a125232f in Status: SUCCESS [ 800.276216] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe7e4325-0a58-45b0-b4d0-e088a125232f deletion is rescheduled due to dependency. [ 800.276689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.557921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.558176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.560947] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fca763b5-9a7f-4d95-beba-d0d5cbf77aea with status ACTIVE [ 800.561199] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.561340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.561414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.561617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.561720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.561886] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.561991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.562115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.564189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.564189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.564189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.564189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.564189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.564189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.564189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.564189] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fca763b5-9a7f-4d95-beba-d0d5cbf77aea is going to be updated. [ 800.567870] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.568858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.568858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.568858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.568858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.568858] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be updated. [ 800.595458] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.595458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.595458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.595458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.595458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.595458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fca763b5-9a7f-4d95-beba-d0d5cbf77aea" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.614363] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.614363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.614363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.614363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.614363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.623571] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: IN_PROGRESS for 2s [ 801.815871] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: SUCCESS [ 801.815871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.815871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.815871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.815871] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.815871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.815871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.815871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.815871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.815871] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.321022] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.519858] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8df9501-2837-46b7-9321-59a6bcbcfa14 req-868b140e-5645-4a50-a18e-2fedb33d1e7a tempest-ServersNegativeTestJSON-1286688584 tempest-ServersNegativeTestJSON-1286688584-project-member] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 802.522105] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 802.522532] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.522717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.522887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.523056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.523190] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.523317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.524090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.524090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.524090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.524090] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.637534] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: SUCCESS [ 802.638440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.643030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.643030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.643030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.643030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.643030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.643030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.643030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.643030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.645057] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.823090] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.026753] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.146887] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.147024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.147082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.147325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.147507] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.147615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.147676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.147828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.147995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.147995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.148185] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.148298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.148363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.148509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.148647] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.148739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.148797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.148927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.149045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.149102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.149185] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.328291] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.328454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.328551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.328811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.328863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.328938] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c is going to be updated. [ 803.363233] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.363601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.363732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.364100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.364266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.377545] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: IN_PROGRESS for 2s [ 803.529425] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.652419] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d26e35f-7f74-471f-aa86-2ea84a3690b8: rpc.has_security_group_logging(os_id): False [ 803.676654] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.676859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.676859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.677141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.677232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.677461] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.677559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.677636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.677824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.677918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.678212] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.678322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.679025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.679025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.679025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.679025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.679025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.679025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.679663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.679807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.679923] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be updated. [ 803.770140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.771364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.771364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.771364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.771619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.787244] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: IN_PROGRESS for 2s [ 804.031229] env[65992]: INFO networking_nsxv3.common.synchronization [req-00fc2675-e86e-44db-8a8a-e5996d4a2777 req-947066f7-0b75-40b5-973a-351101f24fb8 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 804.031684] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.031684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.031854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.032061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.032190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.032319] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be updated. [ 804.033511] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 804.034165] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.034325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.034419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.034681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.034809] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.034903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.034963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.035181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.035378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.035378] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.081882] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.082038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.082104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.082302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.082447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.095302] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: IN_PROGRESS for 2s [ 804.540712] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.540712] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.540712] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 already deleted. [ 804.540712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.542254] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.542498] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.544131] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.544131] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.544131] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.544131] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.544131] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.544131] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.544718] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.544718] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.544718] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.544903] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.544965] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.545154] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.545265] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.545449] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.569888] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.570165] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.570225] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.570426] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.571018] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-3728fd85-6cac-4bf1-913b-c352155a1e00 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.571437] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-3728fd85-6cac-4bf1-913b-c352155a1e00" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.572026] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-3728fd85-6cac-4bf1-913b-c352155a1e00" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.572488] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-3728fd85-6cac-4bf1-913b-c352155a1e00" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.572809] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3728fd85-6cac-4bf1-913b-c352155a1e00',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.076485] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.076485] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.076485] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.076485] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.077139] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.077139] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 3728fd85-6cac-4bf1-913b-c352155a1e00 not found, creating... [ 805.077139] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.077376] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.077376] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.077493] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.077611] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.077898] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.078062] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.078220] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.078436] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.078571] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.078723] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 3728fd85-6cac-4bf1-913b-c352155a1e00 is going to be created. [ 805.106807] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.107219] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.107219] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.107413] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.107633] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.107875] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-3728fd85-6cac-4bf1-913b-c352155a1e00" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.389097] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: SUCCESS [ 805.389338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.389529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.389805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.390011] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.390134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.390220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.390375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.390499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.390599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.390690] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.828349] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: SUCCESS [ 805.828349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.888338] env[65992]: INFO networking_nsxv3.common.synchronization [req-00fc2675-e86e-44db-8a8a-e5996d4a2777 req-6d53567f-daff-4900-8b0f-5ce78af6eedb service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 805.889025] env[65992]: INFO networking_nsxv3.common.synchronization [req-00fc2675-e86e-44db-8a8a-e5996d4a2777 req-6d53567f-daff-4900-8b0f-5ce78af6eedb service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 805.889025] env[65992]: INFO networking_nsxv3.common.synchronization [req-00fc2675-e86e-44db-8a8a-e5996d4a2777 req-6d53567f-daff-4900-8b0f-5ce78af6eedb service nova] Enqueued Resource ID: 3728fd85-6cac-4bf1-913b-c352155a1e00 with Priority: HIGHEST for action port [ 805.889575] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 805.889575] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 805.889761] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3728fd85-6cac-4bf1-913b-c352155a1e00 with Priority: HIGHEST for action port [ 805.890082] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.890779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.890863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.891182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.891274] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.895589] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.895589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.895589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.895589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.895589] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.895589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.895589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.895589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.895589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.895589] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.896105] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-3728fd85-6cac-4bf1-913b-c352155a1e00 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.896105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3728fd85-6cac-4bf1-913b-c352155a1e00" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.896105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3728fd85-6cac-4bf1-913b-c352155a1e00" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.896310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3728fd85-6cac-4bf1-913b-c352155a1e00" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.896365] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3728fd85-6cac-4bf1-913b-c352155a1e00',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.902416] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.902607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.902607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.902844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.903074] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.903229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.903276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.903467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.903612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.903656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.903818] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.903961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.904018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.905873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.906098] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.906239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.906318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.906512] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.906596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.906714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.906812] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.937247] env[65992]: INFO networking_nsxv3.common.synchronization [req-99ad2d3c-1464-48d1-b451-76bb2c97f156 req-cb44fb67-fa32-4691-9af3-85e34b7cb5c1 tempest-ServerTagsTestJSON-958496922 tempest-ServerTagsTestJSON-958496922-project-member] Enqueued Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGHEST for action security_group_members [ 805.937247] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGHEST for action security_group_members [ 805.937247] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.937477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.937477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.938342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.938545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.938689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.938761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.938957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.939057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.939150] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.106402] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 806.106883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.404062] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3728fd85-6cac-4bf1-913b-c352155a1e00 with status ACTIVE [ 806.404062] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.404062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.404062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.404062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.404062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.404062] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.404062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.404062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.404062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.404062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.404680] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.404680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.404680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.404680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.404680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.404833] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3728fd85-6cac-4bf1-913b-c352155a1e00 is going to be updated. [ 806.406030] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.407137] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.407305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.408599] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c: rpc.has_security_group_logging(os_id): False [ 806.426330] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.427084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.427084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.427084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.429307] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.429502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.429592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.429826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.429991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.430193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3728fd85-6cac-4bf1-913b-c352155a1e00" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.444055] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.444286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.451104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.451104] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.451104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.451104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.451399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.451399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.451479] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.451540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.451645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.451786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.451866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.452066] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.452144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.452207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.452366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.452442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.452536] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c is going to be updated. [ 806.453713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.453891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.453991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.454162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.454317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.454381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.454475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.454567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.454816] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 is going to be updated. [ 806.498773] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.498999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.499132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.499428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.499648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.511992] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 in Status: IN_PROGRESS for 2s [ 806.544072] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.544226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.544284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.544488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.544624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.565318] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: IN_PROGRESS for 2s [ 806.909368] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.956588] env[65992]: INFO networking_nsxv3.common.synchronization [req-ea4ca61c-29b9-4115-9898-b9498fe10d51 req-7c74d6d6-4184-4914-8269-6ec561822ad6 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 806.957183] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 806.957481] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.957603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.957689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.957916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.958084] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.958203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.958356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.958424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.958603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.958603] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.412408] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.412802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.412802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.413030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.413129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.413258] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be created. [ 807.439540] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.439540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.439696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.441311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.441311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.455678] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: UNINITIALIZED for 2s [ 807.461804] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.461804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.461804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.462049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.462144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.462351] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.462473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.462550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.462719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.462779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.462868] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d already deleted. [ 807.462947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.468356] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.468554] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.468678] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.468993] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.469535] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.469850] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.470117] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.470452] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.470677] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.470947] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.471198] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.471385] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.471608] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.471817] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.472060] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.472332] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.514248] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.514248] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 807.514450] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.514510] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.515389] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-e9aed156-6530-4301-b264-7bee2c3c24fe taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.515882] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-e9aed156-6530-4301-b264-7bee2c3c24fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.516046] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-e9aed156-6530-4301-b264-7bee2c3c24fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.516440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-e9aed156-6530-4301-b264-7bee2c3c24fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.516584] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9aed156-6530-4301-b264-7bee2c3c24fe',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.019932] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.020366] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.020536] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.020877] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.021047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.021203] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port e9aed156-6530-4301-b264-7bee2c3c24fe not found, creating... [ 808.021474] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.021714] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.021941] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.022214] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.022416] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.022768] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.022937] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.023063] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.023281] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.023420] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.023605] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: e9aed156-6530-4301-b264-7bee2c3c24fe is going to be created. [ 808.045591] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.045770] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.045886] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.046267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.046529] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.046763] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-e9aed156-6530-4301-b264-7bee2c3c24fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.523144] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 in Status: SUCCESS [ 808.523526] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 deletion is rescheduled due to dependency. [ 808.523526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.584123] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: SUCCESS [ 808.584409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.728108] env[65992]: INFO networking_nsxv3.common.synchronization [req-ea4ca61c-29b9-4115-9898-b9498fe10d51 req-be813e45-227c-408b-80a7-ec07577205fa service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 808.728332] env[65992]: INFO networking_nsxv3.common.synchronization [req-ea4ca61c-29b9-4115-9898-b9498fe10d51 req-be813e45-227c-408b-80a7-ec07577205fa service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 808.728482] env[65992]: INFO networking_nsxv3.common.synchronization [req-ea4ca61c-29b9-4115-9898-b9498fe10d51 req-be813e45-227c-408b-80a7-ec07577205fa service nova] Enqueued Resource ID: e9aed156-6530-4301-b264-7bee2c3c24fe with Priority: HIGHEST for action port [ 808.729020] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 808.729337] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 808.729499] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9aed156-6530-4301-b264-7bee2c3c24fe with Priority: HIGHEST for action port [ 808.729874] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.730094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.730227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.730535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.730669] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.732468] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.733401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.733571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.733820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.734364] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.735730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.735730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.735730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.735730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.735988] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.737661] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9aed156-6530-4301-b264-7bee2c3c24fe taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.737839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9aed156-6530-4301-b264-7bee2c3c24fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.737949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9aed156-6530-4301-b264-7bee2c3c24fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.738229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9aed156-6530-4301-b264-7bee2c3c24fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.738316] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9aed156-6530-4301-b264-7bee2c3c24fe',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.233460] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.233460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.238751] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.241039] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9aed156-6530-4301-b264-7bee2c3c24fe with status ACTIVE [ 809.241039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.241039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.241039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.241039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.241039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.241039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.241039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.241966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.241966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.241966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.241966] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.241966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.241966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.241966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.241966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.241966] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9aed156-6530-4301-b264-7bee2c3c24fe is going to be updated. [ 809.268979] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.269250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.269250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.269818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.269818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.269818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9aed156-6530-4301-b264-7bee2c3c24fe" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.469330] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 809.470525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.476248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.476248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.476248] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.476248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.476248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.476248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.476248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.476248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.476248] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.741362] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.785245] env[65992]: INFO networking_nsxv3.common.synchronization [req-bbd5c589-749f-479a-a747-72b963da79f4 req-48dd23a4-607c-4579-80cc-e6c0b9c64b7e tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 809.786430] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 809.786489] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.786634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.786704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.787207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.787277] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.787366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.787426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.787791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.787791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.787913] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.981146] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.984946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.984946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.984946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.984946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.985745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.985745] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.247412] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.248175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.248175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.248701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.248701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.248701] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be created. [ 810.282013] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.283573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.283704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.283947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.284962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.290171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.290499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.290499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.290713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.290929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.290997] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.291145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.291145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.291328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.291453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.291530] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 already deleted. [ 810.291575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.301738] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: UNINITIALIZED for 2s [ 810.388809] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.389019] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.389147] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.389507] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.389783] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.389955] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.390809] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.390809] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.390809] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.390809] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.390809] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.391082] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.391082] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.391164] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.391239] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.391378] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.417094] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.417094] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.417291] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.417434] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.417847] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-9fce0292-24b8-4e6b-a378-26276a59026d taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.418105] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-9fce0292-24b8-4e6b-a378-26276a59026d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.418373] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-9fce0292-24b8-4e6b-a378-26276a59026d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.418726] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-9fce0292-24b8-4e6b-a378-26276a59026d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.418906] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fce0292-24b8-4e6b-a378-26276a59026d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.488529] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6417014f-241b-4b36-8b7b-aeef9e200013: rpc.has_security_group_logging(os_id): False [ 810.510515] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.510515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.510515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.510844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.510844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.511113] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.511113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.511347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.511347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.511347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.511802] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.511802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.511802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.511979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.511979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.512136] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.512225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.512274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.512414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.512491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.512575] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be created. [ 810.577019] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.577019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.577019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.577019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.577019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.590857] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 810.921286] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.921636] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.921636] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.923024] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.923024] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.923024] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 9fce0292-24b8-4e6b-a378-26276a59026d not found, creating... [ 810.923024] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.923256] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.923372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.923651] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.923791] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.924227] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.924331] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.924373] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.924596] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.924750] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.924896] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 9fce0292-24b8-4e6b-a378-26276a59026d is going to be created. [ 810.949210] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.949659] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.949659] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.949842] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.950103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.950320] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-9fce0292-24b8-4e6b-a378-26276a59026d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.677046] env[65992]: INFO networking_nsxv3.common.synchronization [req-bbd5c589-749f-479a-a747-72b963da79f4 req-cfc8d52f-e9e6-476c-a6fb-e344692d462c service nova] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_rules [ 811.677420] env[65992]: INFO networking_nsxv3.common.synchronization [req-bbd5c589-749f-479a-a747-72b963da79f4 req-cfc8d52f-e9e6-476c-a6fb-e344692d462c service nova] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 811.677648] env[65992]: INFO networking_nsxv3.common.synchronization [req-bbd5c589-749f-479a-a747-72b963da79f4 req-cfc8d52f-e9e6-476c-a6fb-e344692d462c service nova] Enqueued Resource ID: 9fce0292-24b8-4e6b-a378-26276a59026d with Priority: HIGHEST for action port [ 811.678227] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_rules [ 811.678380] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 811.678477] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fce0292-24b8-4e6b-a378-26276a59026d with Priority: HIGHEST for action port [ 811.678775] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.680179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.680179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.680179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.680179] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.681564] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.682612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.682612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.682612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.682764] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.682814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.683791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.683870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.684015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.684125] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.685542] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fce0292-24b8-4e6b-a378-26276a59026d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.685745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fce0292-24b8-4e6b-a378-26276a59026d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.685831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fce0292-24b8-4e6b-a378-26276a59026d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.686885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fce0292-24b8-4e6b-a378-26276a59026d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.686885] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fce0292-24b8-4e6b-a378-26276a59026d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.183568] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.183568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.186187] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.188755] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fce0292-24b8-4e6b-a378-26276a59026d with status ACTIVE [ 812.188986] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.189265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.189425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.190024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.190024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.190196] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.190369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.190611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.191529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.191529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.191529] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.191529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.191529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.191761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.191761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.192097] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fce0292-24b8-4e6b-a378-26276a59026d is going to be updated. [ 812.220416] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.220628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.220755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.220977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.221271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.222058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fce0292-24b8-4e6b-a378-26276a59026d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.316562] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 812.316865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.317094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.317548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.317548] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.317728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.317728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.319394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.319394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.319394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.319394] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.612503] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 812.613129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.694716] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.821361] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.821515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.821590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.822561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.822561] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.822561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.822561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.822561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.822561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.822561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.822953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.822953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.822953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.822953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.823110] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.823155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.823188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.823345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.823417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.823494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.823580] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.197619] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.197901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.198165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.198451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.198560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.198679] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be created. [ 813.231284] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.231544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.231671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.231935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.232185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.246155] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: UNINITIALIZED for 2s [ 813.304156] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-4fd3bcfe-900a-4a59-8c97-9b02036e9bf9 tempest-ListServersNegativeTestJSON-2099661029 tempest-ListServersNegativeTestJSON-2099661029-project-member] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 813.304871] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 813.305294] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.305881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.305998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.307026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.307276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.307358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.307436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.307604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.307694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.307809] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.326484] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a7f9db-1203-43be-8fe2-0b76907a767d: rpc.has_security_group_logging(os_id): False [ 813.347457] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.347784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.347942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.348279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.348486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.348863] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.349025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.349113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.349346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.349467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.349797] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.349926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.349926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.350138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.350224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.350449] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.350674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.350674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.350788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.350941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.350941] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be created. [ 813.429232] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.429605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.429689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.429911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.430108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.444021] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 813.767112] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.767483] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.767994] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.768588] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.768905] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.769084] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.769249] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.770187] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.770187] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.770187] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.770187] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.770187] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.770499] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.770499] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.770499] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.770685] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.797175] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.797388] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 813.797536] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.797738] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.798136] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-6bf70f0c-a40e-4fce-a465-64817c446585 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.798348] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-6bf70f0c-a40e-4fce-a465-64817c446585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.798461] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-6bf70f0c-a40e-4fce-a465-64817c446585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.798878] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-6bf70f0c-a40e-4fce-a465-64817c446585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.798991] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bf70f0c-a40e-4fce-a465-64817c446585',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.809828] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.809996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.810101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.810399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.810566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.810796] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.810918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.810978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.811180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.811266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.811604] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 already deleted. [ 813.811604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.302178] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.302596] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.302596] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.302898] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.303082] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.303255] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 6bf70f0c-a40e-4fce-a465-64817c446585 not found, creating... [ 814.303657] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.303834] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.303984] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.304244] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.304396] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.304782] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.304969] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.305087] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.305393] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.305553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.305693] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 6bf70f0c-a40e-4fce-a465-64817c446585 is going to be created. [ 814.334496] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.334766] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.334890] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.335730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.336509] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.336831] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-6bf70f0c-a40e-4fce-a465-64817c446585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.018740] env[65992]: INFO networking_nsxv3.common.synchronization [req-56a8f7a8-faa9-4684-afde-de030f6ccf4c req-b460e60f-3ebe-432d-9c35-e463e7dfe58f tempest-ListImageFiltersTestJSON-580190969 tempest-ListImageFiltersTestJSON-580190969-project-member] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 815.018910] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGHEST for action security_group_members [ 815.019211] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.019408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.019540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.019798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.020044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.020188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.020272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.020468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.020594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.020706] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.056131] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-52cac8ec-6f1a-457c-ac9f-55b9b7a3c269 service nova] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_rules [ 815.056131] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-52cac8ec-6f1a-457c-ac9f-55b9b7a3c269 service nova] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 815.056131] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-52cac8ec-6f1a-457c-ac9f-55b9b7a3c269 service nova] Enqueued Resource ID: 6bf70f0c-a40e-4fce-a465-64817c446585 with Priority: HIGHEST for action port [ 815.056586] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_rules [ 815.056973] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 815.056973] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf70f0c-a40e-4fce-a465-64817c446585 with Priority: HIGHEST for action port [ 815.057167] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.057260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.057323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.057639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.057753] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.059349] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.059349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.059349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.059349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.059349] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.059587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.059587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.059656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.059726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.059819] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.062492] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bf70f0c-a40e-4fce-a465-64817c446585 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.062492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bf70f0c-a40e-4fce-a465-64817c446585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.062492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bf70f0c-a40e-4fce-a465-64817c446585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.062492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bf70f0c-a40e-4fce-a465-64817c446585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.062492] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bf70f0c-a40e-4fce-a465-64817c446585',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.220598] env[65992]: INFO networking_nsxv3.common.synchronization [req-dd431155-f77c-4902-acc2-8666424aabe8 req-23e1b025-4017-41a2-bc44-00cea2d5cba4 tempest-ListServerFiltersTestJSON-1509451299 tempest-ListServerFiltersTestJSON-1509451299-project-member] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 815.221317] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 815.221658] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.221794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.221867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.222072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.222668] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.222668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.222668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.222668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.222668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.222668] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.259405] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: SUCCESS [ 815.259642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.259815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.260038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.260238] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.260359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.260421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.260573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.260651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.260733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.260829] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.459028] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 815.459378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.523726] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.523952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.524036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.524308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.524701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.524980] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.525275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.525275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.525802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.525868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.526013] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be updated. [ 815.556328] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.556474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.556474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.556691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.556830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.564656] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.564656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.564656] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.565089] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bf70f0c-a40e-4fce-a465-64817c446585 with status ACTIVE [ 815.566493] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.566493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.566493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.566493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.566493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.566907] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.567039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.567106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.567278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.567365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.567982] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.567982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.567982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.568142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.568142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.568232] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bf70f0c-a40e-4fce-a465-64817c446585 is going to be updated. [ 815.569921] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: IN_PROGRESS for 2s [ 815.592885] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.592885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.593220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.593220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.594834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.594834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bf70f0c-a40e-4fce-a465-64817c446585" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.726822] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.766783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.766783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.766783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.766783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.766783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.767544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.767544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.767544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.767544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.767544] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.974824] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-1dbf3d39-7fad-4f82-8841-01ed7355fe42 tempest-ListServersNegativeTestJSON-2099661029 tempest-ListServersNegativeTestJSON-2099661029-project-member] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 815.975844] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 815.976306] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.976496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.071103] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.230340] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.270093] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 724ff346-b8e9-4eb5-b30d-7bfeb697d754: rpc.has_security_group_logging(os_id): False [ 816.297860] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.297860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.298876] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.299331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.299578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.300091] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.300378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.300548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.300828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.301527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.303157] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.303157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.303157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.303157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.303157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.303157] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.303157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.303157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.303157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.303157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.306017] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be created. [ 816.393601] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.393601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.393601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.393767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.393990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.398649] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.398649] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.398866] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.399985] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.400267] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.400619] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.400842] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.401264] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.401493] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.401826] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.402059] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.402231] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.402648] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.402762] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.402987] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.403250] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.414781] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: IN_PROGRESS for 2s [ 816.427529] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.427675] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.427823] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.428104] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.428848] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-c1e61328-3c41-4148-93fd-c130bb699e3f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.429120] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-c1e61328-3c41-4148-93fd-c130bb699e3f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.429367] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-c1e61328-3c41-4148-93fd-c130bb699e3f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.430687] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-c1e61328-3c41-4148-93fd-c130bb699e3f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.430687] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1e61328-3c41-4148-93fd-c130bb699e3f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.575342] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.575666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.575666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.575773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.575854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.575901] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be created. [ 816.608426] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.608620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.608726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.608925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.609105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.622990] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: UNINITIALIZED for 2s [ 816.735612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.735612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.735612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.735612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.735612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.735612] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 816.770605] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.770795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.770890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.771079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.771227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.782127] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 816.932636] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.932877] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.932994] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.933347] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.933578] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.933829] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port c1e61328-3c41-4148-93fd-c130bb699e3f not found, creating... [ 816.934229] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.934408] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.934526] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.934761] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.934896] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.935207] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.935372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.935502] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.935752] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.935893] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.936058] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: c1e61328-3c41-4148-93fd-c130bb699e3f is going to be created. [ 816.960040] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.960040] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.960040] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.961025] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.961025] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.961025] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-c1e61328-3c41-4148-93fd-c130bb699e3f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.581247] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf in Status: SUCCESS [ 817.581664] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf deletion is rescheduled due to dependency. [ 817.581664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.748010] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-e58b860b-df9d-4e51-ae8b-98fae6659278 service nova] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_rules [ 817.748010] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-e58b860b-df9d-4e51-ae8b-98fae6659278 service nova] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 817.748010] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-e58b860b-df9d-4e51-ae8b-98fae6659278 service nova] Enqueued Resource ID: c1e61328-3c41-4148-93fd-c130bb699e3f with Priority: HIGHEST for action port [ 817.748388] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_rules [ 817.749269] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 817.749269] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e61328-3c41-4148-93fd-c130bb699e3f with Priority: HIGHEST for action port [ 817.749269] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.749269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.749543] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.749602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.749832] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1e61328-3c41-4148-93fd-c130bb699e3f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.749964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1e61328-3c41-4148-93fd-c130bb699e3f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.750058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1e61328-3c41-4148-93fd-c130bb699e3f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.750305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1e61328-3c41-4148-93fd-c130bb699e3f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.750462] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1e61328-3c41-4148-93fd-c130bb699e3f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.254176] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1e61328-3c41-4148-93fd-c130bb699e3f with status ACTIVE [ 818.254407] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.254548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.254630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.254834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.254927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.255125] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.255231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.255306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.255434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.255521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.255704] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.255795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.255848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.255984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.256069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.256150] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1e61328-3c41-4148-93fd-c130bb699e3f is going to be updated. [ 818.282191] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.282586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.282781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.283266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.283641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.283904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1e61328-3c41-4148-93fd-c130bb699e3f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.438307] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: SUCCESS [ 818.438307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.636025] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 818.636025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.636025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.636025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.636025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.636025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.636025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.636025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.636025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.636025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.636025] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.637137] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.637410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.637598] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.637799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.637799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.638106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.638106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.638106] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.794398] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 818.794715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.142436] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.142436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.143281] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.646441] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.150082] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.150357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.150411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.150671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.150766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.150868] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 820.187327] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.187535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.187535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.187734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.187877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.202211] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 820.989960] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e1dbc936-7fb6-4685-ae82-db2b470a6750 None None] Enqueued Resource ID: b2c7ded0-4893-40c0-a85f-be2a1b528e39 with Priority: HIGHEST for action port [ 820.990686] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c7ded0-4893-40c0-a85f-be2a1b528e39 with Priority: HIGHEST for action port [ 820.990903] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2c7ded0-4893-40c0-a85f-be2a1b528e39 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.993097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2c7ded0-4893-40c0-a85f-be2a1b528e39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.993325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2c7ded0-4893-40c0-a85f-be2a1b528e39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.993551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2c7ded0-4893-40c0-a85f-be2a1b528e39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.993637] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2c7ded0-4893-40c0-a85f-be2a1b528e39',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.362620] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-9c214888-63b9-4ce9-a65f-d9c2ef60e2df tempest-ListServersNegativeTestJSON-2099661029 tempest-ListServersNegativeTestJSON-2099661029-project-member] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 821.365169] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 821.365169] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.365169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.497413] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2c7ded0-4893-40c0-a85f-be2a1b528e39 [ 821.497654] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.497791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.497855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.498079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.498176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.498303] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2c7ded0-4893-40c0-a85f-be2a1b528e39 already deleted. [ 821.498377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2c7ded0-4893-40c0-a85f-be2a1b528e39" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.219800] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 822.220167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.220287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.220530] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.220755] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.220895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.220959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.221145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.221230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.221325] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.245017] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.245626] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.245892] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.246369] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.246758] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.247735] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.247735] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.247735] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.247735] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.247735] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.247940] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.247940] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.248046] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.248150] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.248358] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.248464] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.274797] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.275008] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.275008] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.275168] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-668" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.275168] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-9f3e3fd4-06ce-4188-b73d-044de992d65f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.275756] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-9f3e3fd4-06ce-4188-b73d-044de992d65f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.275826] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-9f3e3fd4-06ce-4188-b73d-044de992d65f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.276195] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-9f3e3fd4-06ce-4188-b73d-044de992d65f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.276375] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3e3fd4-06ce-4188-b73d-044de992d65f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.727322] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.779564] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.779801] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.779943] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.780245] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.780402] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.780544] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 9f3e3fd4-06ce-4188-b73d-044de992d65f not found, creating... [ 822.780818] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.781054] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.781193] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.781547] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.781696] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.782054] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.782223] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.782339] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.782715] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.782883] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.783033] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 9f3e3fd4-06ce-4188-b73d-044de992d65f is going to be created. [ 822.805759] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.806011] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.806155] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.807106] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.807106] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.807106] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-9f3e3fd4-06ce-4188-b73d-044de992d65f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.199327] env[65992]: INFO networking_nsxv3.common.synchronization [None req-41556ece-9090-4c89-93a0-170bc75604a0 None None] Enqueued Resource ID: 058fc3fc-bac3-479c-9fb2-868207d224d9 with Priority: HIGHEST for action port [ 823.199870] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058fc3fc-bac3-479c-9fb2-868207d224d9 with Priority: HIGHEST for action port [ 823.200476] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-058fc3fc-bac3-479c-9fb2-868207d224d9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.200476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-058fc3fc-bac3-479c-9fb2-868207d224d9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.201067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-058fc3fc-bac3-479c-9fb2-868207d224d9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.201067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-058fc3fc-bac3-479c-9fb2-868207d224d9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.201364] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('058fc3fc-bac3-479c-9fb2-868207d224d9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.230285] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.584026] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-e5cfb2fe-028a-43ed-ba90-103a8cc5bd9f service nova] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_rules [ 823.584026] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-e5cfb2fe-028a-43ed-ba90-103a8cc5bd9f service nova] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 823.584026] env[65992]: INFO networking_nsxv3.common.synchronization [req-71381586-a0db-44e9-9bff-8a2e36225487 req-e5cfb2fe-028a-43ed-ba90-103a8cc5bd9f service nova] Enqueued Resource ID: 9f3e3fd4-06ce-4188-b73d-044de992d65f with Priority: HIGHEST for action port [ 823.584026] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_rules [ 823.584026] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 823.584026] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f3e3fd4-06ce-4188-b73d-044de992d65f with Priority: HIGHEST for action port [ 823.584026] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.584026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.585082] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.585311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.585606] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f3e3fd4-06ce-4188-b73d-044de992d65f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.587511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f3e3fd4-06ce-4188-b73d-044de992d65f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.587511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f3e3fd4-06ce-4188-b73d-044de992d65f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.587511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f3e3fd4-06ce-4188-b73d-044de992d65f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.587511] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3e3fd4-06ce-4188-b73d-044de992d65f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.705463] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 058fc3fc-bac3-479c-9fb2-868207d224d9 [ 823.705700] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.705848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.707141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.707141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.707141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.707141] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:058fc3fc-bac3-479c-9fb2-868207d224d9 already deleted. [ 823.707141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-058fc3fc-bac3-479c-9fb2-868207d224d9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.732765] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.735310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.735310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.735310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.735310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.735310] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 823.767583] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.767741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.767787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.773021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.773021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.778816] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 824.092621] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f3e3fd4-06ce-4188-b73d-044de992d65f with status ACTIVE [ 824.093015] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.093214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.093301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.093906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.093906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.094095] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.094170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.094219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.095069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.095069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.095069] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.095069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.095069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.095069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.095069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.095489] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f3e3fd4-06ce-4188-b73d-044de992d65f is going to be updated. [ 824.130539] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.130539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.130901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.130901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.131075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.131404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f3e3fd4-06ce-4188-b73d-044de992d65f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.135062] env[65992]: INFO networking_nsxv3.common.synchronization [None req-0dfc9014-a309-42c1-ae99-0f26dd00d072 None None] Enqueued Resource ID: 293b0c3b-8a44-4051-bfd3-4116b5d1c742 with Priority: HIGHEST for action port [ 825.135657] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 293b0c3b-8a44-4051-bfd3-4116b5d1c742 with Priority: HIGHEST for action port [ 825.135967] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-293b0c3b-8a44-4051-bfd3-4116b5d1c742 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.136145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-293b0c3b-8a44-4051-bfd3-4116b5d1c742" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.136192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-293b0c3b-8a44-4051-bfd3-4116b5d1c742" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.136489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-293b0c3b-8a44-4051-bfd3-4116b5d1c742" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.136591] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('293b0c3b-8a44-4051-bfd3-4116b5d1c742',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.642065] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 293b0c3b-8a44-4051-bfd3-4116b5d1c742 [ 825.642065] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.642065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.642065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.642065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.642065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.642065] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:293b0c3b-8a44-4051-bfd3-4116b5d1c742 already deleted. [ 825.642065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-293b0c3b-8a44-4051-bfd3-4116b5d1c742" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.794472] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 825.794805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.795066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.795424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.795646] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.795823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.795955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.796205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.796296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.797100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.797100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.797100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.797100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.797100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.797100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.797100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.797458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.798029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.798029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.798029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.798029] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.801561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.801561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.801561] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.801561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.801561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.801561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.801973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.801973] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.804630] env[65992]: INFO networking_nsxv3.common.synchronization [req-3d5e422f-8ec6-49dd-afdc-00b2c1b83e63 req-bf7968ce-f7ab-4f5d-8eb1-0c7c88987a33 tempest-FloatingIPsAssociationTestJSON-1610940676 tempest-FloatingIPsAssociationTestJSON-1610940676-project-member] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 825.805255] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 825.806394] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.806568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.806649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.806871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.807215] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.807215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.807357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.807466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.807617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.807691] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.029025] env[65992]: INFO networking_nsxv3.common.synchronization [req-41c80711-d85f-454c-8fa8-ee40e977b7c0 req-a933cfe9-2365-4e58-b59f-6031fc18fc05 tempest-ServerActionsV293TestJSON-1691925799 tempest-ServerActionsV293TestJSON-1691925799-project-member] Enqueued Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_members [ 826.029025] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 with Priority: HIGHEST for action security_group_members [ 826.029025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.029482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.029675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.029986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.030313] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.030579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.030760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.031070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.031283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.031521] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.301777] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 010c8cc5-bfff-46eb-9de7-49acf403b856: rpc.has_security_group_logging(os_id): False [ 826.303478] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.313107] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.322731] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.322935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.323034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.323253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.323342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.323595] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.323698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.323761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.323912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.323986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.324214] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.324323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.324406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.324511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.324601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.324788] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.324882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.324943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.325095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.325205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.325241] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be created. [ 826.391718] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.391936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.392088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.392382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.392692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.409665] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 826.534658] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.537110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.537110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.537110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.564942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.564942] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.564942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.564942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.564942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.564942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.564942] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 is going to be updated. [ 826.593744] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.593915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.593964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.594169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.594997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.604633] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 in Status: IN_PROGRESS for 2s [ 826.809387] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.816141] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.836136] env[65992]: INFO networking_nsxv3.common.synchronization [req-9225b225-b658-491f-9af7-1568b987f895 req-121c1878-7b7a-47bb-8a64-fcb8a3cd35df tempest-ServersAdminTestJSON-561694848 tempest-ServersAdminTestJSON-561694848-project-member] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 826.836136] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 826.836401] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.836568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.836620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.839867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.840171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.840650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.840828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.842485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.842485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.842485] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.313818] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.313818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.314273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.314273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.314396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.314754] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 827.320372] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.320372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.320372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.320372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.320372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.320372] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be updated. [ 827.324323] env[65992]: INFO networking_nsxv3.common.synchronization [None req-81c3693c-50ae-4148-9ea0-be0b292d47ff None None] Enqueued Resource ID: d6955e9b-21a8-4258-9997-fa2c6a6d4ffb with Priority: HIGHEST for action port [ 827.330022] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6955e9b-21a8-4258-9997-fa2c6a6d4ffb with Priority: HIGHEST for action port [ 827.333119] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6955e9b-21a8-4258-9997-fa2c6a6d4ffb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.333119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6955e9b-21a8-4258-9997-fa2c6a6d4ffb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.333119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6955e9b-21a8-4258-9997-fa2c6a6d4ffb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.333119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6955e9b-21a8-4258-9997-fa2c6a6d4ffb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.333119] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6955e9b-21a8-4258-9997-fa2c6a6d4ffb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.343785] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.362049] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.362294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.362355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.362641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.362866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.365932] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.365932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.365932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.366199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.366253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.378322] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 827.379102] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: IN_PROGRESS for 2s [ 827.837301] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6955e9b-21a8-4258-9997-fa2c6a6d4ffb [ 827.837543] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.837679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.837746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.838059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.838180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.838281] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6955e9b-21a8-4258-9997-fa2c6a6d4ffb already deleted. [ 827.838383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6955e9b-21a8-4258-9997-fa2c6a6d4ffb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.847227] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.349843] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.350182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.350182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.350254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.350306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.350820] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 828.357044] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e3cb3721-5dfc-4716-b1ae-46cd387df151 None None] Enqueued Resource ID: dca63ef4-f06f-4909-bf8d-363b42234ae2 with Priority: HIGHEST for action port [ 828.357044] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dca63ef4-f06f-4909-bf8d-363b42234ae2 with Priority: HIGHEST for action port [ 828.357044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-dca63ef4-f06f-4909-bf8d-363b42234ae2 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.357044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dca63ef4-f06f-4909-bf8d-363b42234ae2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.357905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dca63ef4-f06f-4909-bf8d-363b42234ae2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.358208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dca63ef4-f06f-4909-bf8d-363b42234ae2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.359026] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca63ef4-f06f-4909-bf8d-363b42234ae2',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.383774] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.383945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.384073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.384410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.384606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.396568] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 828.422638] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 828.422838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.423643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.423867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.423975] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.454244] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-23c1f03a-5d15-4bfc-88a4-c0697f8fe9fe tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 828.454789] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 828.455114] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.455238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.455305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.455568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.455738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.455841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.455891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.456269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.456367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.456467] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.618627] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 in Status: SUCCESS [ 828.618627] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23 deletion is rescheduled due to dependency. [ 828.618627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.861907] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dca63ef4-f06f-4909-bf8d-363b42234ae2 [ 828.862295] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.863824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.863824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.863824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.863824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.863824] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dca63ef4-f06f-4909-bf8d-363b42234ae2 already deleted. [ 828.863824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dca63ef4-f06f-4909-bf8d-363b42234ae2" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.930448] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.930448] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.958495] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.959839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.959839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.959839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.959839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.959839] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.959839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.959839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.960189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.960189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.960189] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 already deleted. [ 828.960189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.047453] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-686af700-142b-49d4-a3d4-fc012bb9c7c2 tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 829.047453] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 829.048558] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.048936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.049129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.049584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.051609] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.051609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.051609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.051609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.051609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.051609] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.400478] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: SUCCESS [ 829.400478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.400478] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 829.400478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.400478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.400478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.400478] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.400478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.400478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.400478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.400478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.400478] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.554008] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.554276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.554389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.554706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.554854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.555184] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.555340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.555441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.555684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.555804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.555930] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 already deleted. [ 829.556063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.678477] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-0f0d35b6-bc4a-4639-8e3a-149bd889d5fe tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 829.678477] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 829.681784] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.682489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.682489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.682489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.682817] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.682936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.682999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.683681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.683812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.684693] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.903430] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.182099] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.182099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-781" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.182099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-781" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.182099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-781" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.182099] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.182099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.182099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.182099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.182099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.182652] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.182702] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.182860] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.183029] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.183212] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.183375] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.183565] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.188585] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.188739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.188805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.189012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.189095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.189290] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.189383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.189442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.189620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.189738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.189774] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 already deleted. [ 830.189840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.206096] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.206328] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 830.206463] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.209967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-781" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.209967] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-2eb88f5b-9238-498b-9006-73556ed8634f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.209967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-2eb88f5b-9238-498b-9006-73556ed8634f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.209967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-2eb88f5b-9238-498b-9006-73556ed8634f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.209967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-2eb88f5b-9238-498b-9006-73556ed8634f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.210512] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eb88f5b-9238-498b-9006-73556ed8634f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.407039] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.409560] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 830.410131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.714280] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.714280] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.714280] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.714643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.714643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.714732] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 2eb88f5b-9238-498b-9006-73556ed8634f not found, creating... [ 830.715059] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.715430] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.715430] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.715542] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.715655] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.715955] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.717646] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.717832] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.718094] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.718218] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.719185] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 2eb88f5b-9238-498b-9006-73556ed8634f is going to be created. [ 830.744395] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.744949] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.744949] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.745142] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.745836] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.746175] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-2eb88f5b-9238-498b-9006-73556ed8634f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.911600] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.911765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.911833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.912077] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.912167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.912266] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 830.954042] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.954265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.954355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.954560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.954712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.965856] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 831.013269] env[65992]: INFO networking_nsxv3.common.synchronization [None req-ea5090cf-d861-44a7-b13e-28efd40e92d9 None None] Enqueued Resource ID: 85226d38-e8ab-435d-9280-379b23cd9db9 with Priority: HIGHEST for action port [ 831.014025] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85226d38-e8ab-435d-9280-379b23cd9db9 with Priority: HIGHEST for action port [ 831.014409] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-85226d38-e8ab-435d-9280-379b23cd9db9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.014732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85226d38-e8ab-435d-9280-379b23cd9db9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.014732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85226d38-e8ab-435d-9280-379b23cd9db9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.015518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85226d38-e8ab-435d-9280-379b23cd9db9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.015518] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85226d38-e8ab-435d-9280-379b23cd9db9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.519988] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85226d38-e8ab-435d-9280-379b23cd9db9 [ 831.520921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.521078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.521216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.521313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.521401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.521717] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85226d38-e8ab-435d-9280-379b23cd9db9 already deleted. [ 831.521717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85226d38-e8ab-435d-9280-379b23cd9db9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.566996] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-107fdf31-ec1c-4df4-92f4-fe7cc53ee7b3 service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 831.566996] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-107fdf31-ec1c-4df4-92f4-fe7cc53ee7b3 service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 831.566996] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-107fdf31-ec1c-4df4-92f4-fe7cc53ee7b3 service nova] Enqueued Resource ID: 2eb88f5b-9238-498b-9006-73556ed8634f with Priority: HIGHEST for action port [ 831.567576] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 831.572434] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 831.572434] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb88f5b-9238-498b-9006-73556ed8634f with Priority: HIGHEST for action port [ 831.572434] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.572434] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.572434] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.572434] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.572434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.573547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.573547] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.573841] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eb88f5b-9238-498b-9006-73556ed8634f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.573841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eb88f5b-9238-498b-9006-73556ed8634f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.574194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eb88f5b-9238-498b-9006-73556ed8634f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.574392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eb88f5b-9238-498b-9006-73556ed8634f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.574465] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eb88f5b-9238-498b-9006-73556ed8634f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.076702] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.079126] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.079126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.079814] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2eb88f5b-9238-498b-9006-73556ed8634f with status ACTIVE [ 832.080041] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.080165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.080260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.080555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.080691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.080937] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.081290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.081290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.081290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.081435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.081567] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.081666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.081724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.081870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.081961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.082101] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2eb88f5b-9238-498b-9006-73556ed8634f is going to be updated. [ 832.108301] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.108546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.108655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.108942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.109143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.109373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eb88f5b-9238-498b-9006-73556ed8634f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.214695] env[65992]: INFO networking_nsxv3.common.synchronization [req-5f4a4391-f0ee-4ae8-84d5-8e4b764a839e req-9422a585-4a46-43dc-80a8-291e1f9f5363 tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 832.217399] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 832.217806] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.217998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.218123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.218297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.218510] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.218611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.218679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.218845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.218928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.219020] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.580054] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.596103] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-710 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.596379] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-710" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.596508] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-710" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596838] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-710" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.597109] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.597262] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.597373] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.597585] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.598276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.598509] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.598679] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.598826] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.598966] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.599125] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.599263] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.599456] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.622088] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.622270] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.622409] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.622579] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-710" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.622913] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.623100] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.623215] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.623547] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.623688] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77fa7ba-dcd6-409a-bb3c-30cad0210ad9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.721622] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.721822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.721869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.722093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.722187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.722397] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.722504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.722565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.722846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.722846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.722967] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 832.759301] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.760891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.760891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.760891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.760891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.771097] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 832.977145] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 832.977420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.977547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.977863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.978110] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.978855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.978855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.978855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.978855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.978855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.978855] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.083258] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.083497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.083582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.083874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.084010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.084160] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be created. [ 833.111981] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.112145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.112212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.112435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.112584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.122666] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: UNINITIALIZED for 2s [ 833.126362] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.126844] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.126844] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.127073] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.127257] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.127470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port e77fa7ba-dcd6-409a-bb3c-30cad0210ad9 not found, creating... [ 833.127739] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.127903] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.128037] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.128306] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.128517] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.128809] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.128959] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.129262] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.129775] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.129775] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.129940] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: e77fa7ba-dcd6-409a-bb3c-30cad0210ad9 is going to be created. [ 833.154354] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.154354] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.154354] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.154354] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.154354] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.154354] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.481396] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.481602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.481657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.482540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.482540] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.482540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.482540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.482540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.482540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.482540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.482993] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.482993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.482993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.482993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.483169] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.483219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.483255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.483392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.483499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.483559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.483640] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.540086] env[65992]: INFO networking_nsxv3.common.synchronization [None req-cb307901-6d02-4094-b370-7a10904b8fee None None] Enqueued Resource ID: cd792946-7717-47f8-ba4a-473a3dbfdb68 with Priority: HIGHEST for action port [ 833.540933] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd792946-7717-47f8-ba4a-473a3dbfdb68 with Priority: HIGHEST for action port [ 833.541463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd792946-7717-47f8-ba4a-473a3dbfdb68 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.541667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd792946-7717-47f8-ba4a-473a3dbfdb68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.541790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd792946-7717-47f8-ba4a-473a3dbfdb68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.542181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd792946-7717-47f8-ba4a-473a3dbfdb68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.542365] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd792946-7717-47f8-ba4a-473a3dbfdb68',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.899058] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-db0fb590-cd45-4ada-adee-12fce4963616 service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 833.899324] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-db0fb590-cd45-4ada-adee-12fce4963616 service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 833.899324] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-db0fb590-cd45-4ada-adee-12fce4963616 service nova] Enqueued Resource ID: e77fa7ba-dcd6-409a-bb3c-30cad0210ad9 with Priority: HIGHEST for action port [ 833.902099] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 833.902099] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 833.902099] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e77fa7ba-dcd6-409a-bb3c-30cad0210ad9 with Priority: HIGHEST for action port [ 833.902099] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.903444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.903444] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.903444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.904484] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.904484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.904484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.904484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.907568] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77fa7ba-dcd6-409a-bb3c-30cad0210ad9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.987381] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 010c8cc5-bfff-46eb-9de7-49acf403b856: rpc.has_security_group_logging(os_id): False [ 834.004883] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.005042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.006457] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.006457] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.006457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.007337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.007337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.007337] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.007337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.007337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.007337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.007337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.007337] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 834.046782] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd792946-7717-47f8-ba4a-473a3dbfdb68 [ 834.046782] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.046782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.046782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.046782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.046782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.046782] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd792946-7717-47f8-ba4a-473a3dbfdb68 already deleted. [ 834.047193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd792946-7717-47f8-ba4a-473a3dbfdb68" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.091425] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.091425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.091425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.091425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.091425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.105875] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 834.410829] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e77fa7ba-dcd6-409a-bb3c-30cad0210ad9 with status ACTIVE [ 834.410829] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.411079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.411079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.411273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.412377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.412377] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.412377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.412377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.412377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.412377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.412377] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.412377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.412377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.412810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.412810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.412810] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e77fa7ba-dcd6-409a-bb3c-30cad0210ad9 is going to be updated. [ 834.441379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.441542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.441617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.442262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.442262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.442262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e77fa7ba-dcd6-409a-bb3c-30cad0210ad9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.786661] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 834.786661] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a deletion is rescheduled due to dependency. [ 834.786661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.801024] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.801836] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-781" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.801836] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-781" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.801836] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-781" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.802250] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.802250] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.802250] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.802476] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.802517] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.802770] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.802845] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.803075] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.803219] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.803349] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.803478] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.803638] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.825223] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.825395] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.825507] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.825735] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-781" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.825984] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.826175] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.826290] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.826850] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.826850] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('728c2e3c-2d8a-424c-88ae-fd9d04431c6f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.133445] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 835.133805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.133930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.134096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.134287] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.134487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.134487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.134619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.134679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.134747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.134845] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.135723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.135883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.136060] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.136161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.136223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.136400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.136480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.136559] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.330204] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.330421] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.330570] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.330911] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.331111] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.331267] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 728c2e3c-2d8a-424c-88ae-fd9d04431c6f not found, creating... [ 835.331529] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.331716] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.331867] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.332057] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.332195] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.332559] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.332668] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.332773] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.332974] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.333119] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.333253] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 728c2e3c-2d8a-424c-88ae-fd9d04431c6f is going to be created. [ 835.354080] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.354312] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.354430] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.354687] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.354910] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.355148] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.640557] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.640827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.640916] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.116640] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-9d2b0498-3aee-4bb7-b4a2-68a5af829a2d service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 836.116858] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-9d2b0498-3aee-4bb7-b4a2-68a5af829a2d service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 836.117015] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d5c4577-2912-438a-adf9-7fa2917f1827 req-9d2b0498-3aee-4bb7-b4a2-68a5af829a2d service nova] Enqueued Resource ID: 728c2e3c-2d8a-424c-88ae-fd9d04431c6f with Priority: HIGHEST for action port [ 836.117793] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 836.117937] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 836.118121] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 728c2e3c-2d8a-424c-88ae-fd9d04431c6f with Priority: HIGHEST for action port [ 836.118419] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.118548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.118823] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.118892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.119099] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.119206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.119252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.119499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.119555] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('728c2e3c-2d8a-424c-88ae-fd9d04431c6f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.123409] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 836.123800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.123845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.124121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.124121] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.130097] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c3430109-a429-439f-8025-925adfa6a0bc None None] Enqueued Resource ID: 69711d09-cdb4-4872-b664-bb7649fe7b65 with Priority: HIGHEST for action port [ 836.130675] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69711d09-cdb4-4872-b664-bb7649fe7b65 with Priority: HIGHEST for action port [ 836.133675] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-69711d09-cdb4-4872-b664-bb7649fe7b65 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.133675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69711d09-cdb4-4872-b664-bb7649fe7b65" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.133675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69711d09-cdb4-4872-b664-bb7649fe7b65" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.133675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69711d09-cdb4-4872-b664-bb7649fe7b65" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.134315] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69711d09-cdb4-4872-b664-bb7649fe7b65',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.145856] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.413606] env[65992]: INFO networking_nsxv3.common.synchronization [req-15c01fdf-05fb-4e5a-880f-01cc4dff313b req-2e18c168-6c4d-41bc-852a-3e99f11455be tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 836.413606] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 836.413606] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.414527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.414623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.415376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.415376] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.415376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.415376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.415611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.415651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.415852] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.627322] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 728c2e3c-2d8a-424c-88ae-fd9d04431c6f with status ACTIVE [ 836.627322] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.627322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.627322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.627322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.627700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.627812] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.627954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.628043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.628229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.628330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.628761] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.628761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.628761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.628948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.629083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.629187] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 728c2e3c-2d8a-424c-88ae-fd9d04431c6f is going to be updated. [ 836.630480] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.630756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.630863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.631126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.631285] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.631588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.631588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.631588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.631707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.631707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.631777] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.637948] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69711d09-cdb4-4872-b664-bb7649fe7b65 [ 836.638218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.638369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.638453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.638668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.638852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.638852] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69711d09-cdb4-4872-b664-bb7649fe7b65 already deleted. [ 836.638958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69711d09-cdb4-4872-b664-bb7649fe7b65" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.645431] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.645572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.645636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.646067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.646067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.646067] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 836.663133] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.663133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.663133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.663133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.663133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.663133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-728c2e3c-2d8a-424c-88ae-fd9d04431c6f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.678212] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.678413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.678809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.678809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.679033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.690217] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 836.919075] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.919075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.919075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.919338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.919338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.919500] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.919597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.919654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.919796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.919865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.919962] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 837.063598] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.064014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.064085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.064315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.064502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.080449] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 837.133855] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.134267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.134267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.134351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.134518] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.134651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.134710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.134828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.134912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.135108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.135189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.135324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.135324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.135440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.135581] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.135675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.135732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.135867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.136740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.136740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.136740] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.644154] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 010c8cc5-bfff-46eb-9de7-49acf403b856: rpc.has_security_group_logging(os_id): False [ 837.663142] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.664800] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.664800] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.664800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.665394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.665394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.665394] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.665569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.665606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.666370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.666370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.666370] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 837.764053] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.764053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.764053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.764346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.764470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.781354] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 838.703602] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 838.703868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.703998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.704224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.704425] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.704538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.704602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.704745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.704849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.704909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.705071] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.705148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.705204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.705341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.705482] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.705595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.705630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.705751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.705826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.705895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.705980] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.707396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.707634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.707813] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.707967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.708052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.708318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.708318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.708476] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.092417] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 839.092606] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 839.092718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.209815] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94744e32-5aaa-4c96-a135-74003f101fb3: rpc.has_security_group_logging(os_id): False [ 839.210958] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.229407] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.229581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.229627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.229886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.229997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.230239] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.230360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.230973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.230973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.230973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.230973] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.230973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.231191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.231191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.231264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.231474] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.231578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.231637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.232084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.232084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.232084] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be created. [ 839.297814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.298061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.298200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.298505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.298754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.320345] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 839.713811] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.800294] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 839.800514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.218493] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.218696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.218750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.221403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.221526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.221768] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 840.272040] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.272040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.272040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.272040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.272565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.289869] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 841.352057] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 841.353378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.353378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.353598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.353721] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.413379] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 841.413496] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 841.498261] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f509d394-b4f6-4490-b0d1-f097547d0c8a None None] Enqueued Resource ID: 7c1e3f6d-a40a-4f50-8595-e0b98e5a3242 with Priority: HIGHEST for action port [ 841.499070] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c1e3f6d-a40a-4f50-8595-e0b98e5a3242 with Priority: HIGHEST for action port [ 841.500021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c1e3f6d-a40a-4f50-8595-e0b98e5a3242 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.500021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c1e3f6d-a40a-4f50-8595-e0b98e5a3242" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.500165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c1e3f6d-a40a-4f50-8595-e0b98e5a3242" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.500421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c1e3f6d-a40a-4f50-8595-e0b98e5a3242" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.500584] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c1e3f6d-a40a-4f50-8595-e0b98e5a3242',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.524776] env[65992]: INFO networking_nsxv3.common.synchronization [req-b9319be0-169f-4a5e-bc0c-51a9ffbe1472 req-1e0cced9-9231-4891-9260-7b292bfc1714 tempest-ListServersNegativeTestJSON-2099661029 tempest-ListServersNegativeTestJSON-2099661029-project-member] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 841.525991] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 841.527859] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.527859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.527859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.527859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.527859] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.527859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.527859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.528552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.528883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.530022] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.860358] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.860545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.861530] env[65992]: INFO networking_nsxv3.common.synchronization [req-016365e9-247e-42bc-a16f-f5061c460299 req-9e71e2fc-5cd5-45c3-bf1d-49ff9759f468 tempest-ListServerFiltersTestJSON-1509451299 tempest-ListServerFiltersTestJSON-1509451299-project-member] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 841.862966] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGHEST for action security_group_members [ 841.863443] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.864038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.864113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.867057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.867057] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.867057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.867057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.867057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.867057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.867057] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.005051] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c1e3f6d-a40a-4f50-8595-e0b98e5a3242 [ 842.005332] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.005479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.005585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.005828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.005922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.006029] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c1e3f6d-a40a-4f50-8595-e0b98e5a3242 already deleted. [ 842.006113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c1e3f6d-a40a-4f50-8595-e0b98e5a3242" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.032818] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.064689] env[65992]: INFO networking_nsxv3.common.synchronization [req-36990a03-0e02-44f7-95ca-43293733387d req-c7882700-3d8a-4496-a673-c24e6e867280 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 842.065233] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 842.065698] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.065893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.066029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.066678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.066846] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.066964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.067054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.067226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.067312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.067407] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.304054] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 842.304276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.304462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.305581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.305581] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.305581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.305581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.305581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.305581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.305581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.305903] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.373735] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.374028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.374028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.374336] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.398826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.399529] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.399661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.399715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.399921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.400021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.400144] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be updated. [ 842.437321] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.437721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.437890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.438207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.438466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.448663] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: IN_PROGRESS for 2s [ 842.536465] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.571865] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.572254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.574038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.574202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.574315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.574553] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.574667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.574728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.574922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.575012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.575060] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 842.636267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.639280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.639280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.639280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.639280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.650319] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 842.808096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.811021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.811021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.811021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.811021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.812121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.812121] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.826076] env[65992]: INFO networking_nsxv3.common.synchronization [None req-143e0ed0-42fa-47e6-bc50-5605db899e68 tempest-AttachVolumeTestJSON-243931194 tempest-AttachVolumeTestJSON-243931194-project-member] Enqueued Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_rules [ 842.827843] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_rules [ 842.828578] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.828578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.828578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.828767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.828767] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.935473] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e114f583-61fb-4d0f-b03e-68d37f1131e2 tempest-AttachVolumeTestJSON-243931194 tempest-AttachVolumeTestJSON-243931194-project-member] Enqueued Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_rules [ 842.935473] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_rules [ 842.935473] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.935473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.038901] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.042277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.042277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.042836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.042836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.042836] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 843.075307] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.075547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.075632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.075947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.076038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.087363] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 843.314259] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94744e32-5aaa-4c96-a135-74003f101fb3: rpc.has_security_group_logging(os_id): False [ 843.347464] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.347628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.349293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.349293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.349293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.349293] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.349293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.349293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.349293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.349293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.349686] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.350179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.351677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.351677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.351677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.351677] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.351677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.351677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.351677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.352053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.352053] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 843.356251] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.356445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.356587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.356770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.356880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.357018] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 already deleted. [ 843.357319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.357319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.357552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.357631] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.434746] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.435107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.435107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.437902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.437902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.446762] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 843.882712] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.882863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.882948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.883196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.883295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.883392] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 already deleted. [ 843.883474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.953790] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d3a87c9a-d9e9-4190-a6fb-3dcacc85f19a None None] Enqueued Resource ID: b6077e65-7d83-4dce-814d-b01b920668ff with Priority: HIGHEST for action port [ 843.954455] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6077e65-7d83-4dce-814d-b01b920668ff with Priority: HIGHEST for action port [ 843.954647] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6077e65-7d83-4dce-814d-b01b920668ff taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.954769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6077e65-7d83-4dce-814d-b01b920668ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.954833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6077e65-7d83-4dce-814d-b01b920668ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.955409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6077e65-7d83-4dce-814d-b01b920668ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.955540] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6077e65-7d83-4dce-814d-b01b920668ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.460043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6077e65-7d83-4dce-814d-b01b920668ff [ 844.460413] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.460413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.460413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.460634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.461040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.461040] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6077e65-7d83-4dce-814d-b01b920668ff already deleted. [ 844.461040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6077e65-7d83-4dce-814d-b01b920668ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.461824] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 in Status: SUCCESS [ 844.462234] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 deletion is rescheduled due to dependency. [ 844.462234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.661216] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 844.661405] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 844.661544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.098104] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 845.098663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.465822] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 845.466179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.466328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.466642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.466706] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.969545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.969694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.969759] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.970462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.970462] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.970462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.970462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.970753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.970753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.970753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.971461] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.474260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.474598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.474644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.474914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.475196] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.475357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.475466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.475702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.475839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.475983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.476240] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.476400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.476504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.476672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.476820] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.476916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.476978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.477142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.477256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.477381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.477522] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.981502] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94744e32-5aaa-4c96-a135-74003f101fb3: rpc.has_security_group_logging(os_id): False [ 847.002318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.002545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.002632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.002869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.002963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.003197] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.003353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.003517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.003725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.003880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.004093] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.004226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.004278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.004427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.004499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.004697] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.004809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.004869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.005080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.005262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.005262] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 847.096946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.097119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.097192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.097411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.097687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.123624] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 848.688262] env[65992]: INFO networking_nsxv3.common.synchronization [req-50aabefe-e4e3-43f7-acfe-45f6b236ecb1 req-6ac014e9-f613-4400-83d8-275aafca88d5 tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 848.690088] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 848.690088] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.690088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.690088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.690088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.690088] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.690458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.690458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.690458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.690557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.690713] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.962034] env[65992]: INFO networking_nsxv3.common.synchronization [req-50aabefe-e4e3-43f7-acfe-45f6b236ecb1 req-ffb9650f-410a-4beb-99c4-dd63a85d9ed5 tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 848.962034] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 848.962696] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.963093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.144209] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 849.144478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.187159] env[65992]: INFO networking_nsxv3.common.synchronization [req-50aabefe-e4e3-43f7-acfe-45f6b236ecb1 req-c8e8caa8-56fa-4e51-b8b4-19377fc3a538 tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 849.187712] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 849.188155] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.188155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.193794] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.625551] env[65992]: INFO networking_nsxv3.common.synchronization [req-3ea0092b-009b-406b-b5ef-92379cb17867 req-ce455d30-f561-446a-851d-cacd58fe8c45 tempest-FloatingIPsAssociationTestJSON-1610940676 tempest-FloatingIPsAssociationTestJSON-1610940676-project-member] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 849.625551] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGHEST for action security_group_members [ 849.625834] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.626023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.626023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.626605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.626896] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.626989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.627081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.627310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.627431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.627627] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.696465] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.131186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.131186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.131186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.131186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.131186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.131186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.131186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.131186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.131186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.131590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.131590] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be updated. [ 850.162462] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.162607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.162691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.162899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.163049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.177565] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: IN_PROGRESS for 2s [ 850.200301] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.200884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.201043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.201311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.201438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.201525] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 850.231617] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.232199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.232199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.232199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.232361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.243196] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 850.379736] env[65992]: INFO networking_nsxv3.common.synchronization [req-9b48a867-7a36-4f5c-a19b-fa7b69328889 req-8cad87c4-eea5-47fd-98f3-8728c641e3e4 tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 850.380789] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 850.381238] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.381507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.381638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.381924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.382184] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.382396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.382583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.383513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.383513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.383513] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.886300] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.886614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.886614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.886785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.886878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.887083] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.887177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.887235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.887374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.887442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.887534] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be updated. [ 850.914460] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.914597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.914641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.914839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.914978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.927284] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: IN_PROGRESS for 2s [ 852.190401] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 in Status: SUCCESS [ 852.190692] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 deletion is rescheduled due to dependency. [ 852.191500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.252433] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 852.252658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.252833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.253071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.253283] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.253401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.253464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.253650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.253729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.253824] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.756596] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.756764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.756834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.757066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.757156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.757357] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.757458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.757522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.757672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.757748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.757832] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 852.786085] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.786229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.786294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.786501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.786672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.797061] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 852.936944] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: SUCCESS [ 852.937162] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 deletion is rescheduled due to dependency. [ 852.937281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.228116] env[65992]: INFO networking_nsxv3.common.synchronization [req-1ae9706a-ccd0-408b-9c6c-8e4a9bc10298 req-a209a759-1d7d-4298-93d7-fdb9f0a41bbd tempest-ServersAdminTestJSON-561694848 tempest-ServersAdminTestJSON-561694848-project-member] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 853.228781] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 853.229216] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.229659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.229821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.229957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.230139] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.230240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.231273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.231273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.231273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.231273] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.733032] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.236446] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.739477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.739477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.739477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.739650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.739650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.739754] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 854.770872] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.771025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.771071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.771257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.771392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.782206] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 854.806826] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 854.807027] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 deletion is rescheduled due to dependency. [ 854.807144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.807307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.807518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.807700] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.807819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.807879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.808035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.808116] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.808214] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.968015] env[65992]: INFO networking_nsxv3.common.synchronization [req-273cf791-9cbe-436c-b2fa-6f2c03a7229c req-4d369fad-0e39-47df-a219-4b32d9f76d5f tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 854.968015] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 854.968015] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.968015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.968015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.969527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.969527] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.969527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.969527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.969527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.969527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.969527] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.313035] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.313035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.313035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.313035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.313035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.313035] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.313035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.313035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.313035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.313035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.313035] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 855.340774] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.340940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.340995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.342042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.342042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.345767] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.346115] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.346307] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.346692] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.347982] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.348177] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.350027] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.350027] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.350027] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.350027] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.350027] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.350027] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.350027] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.350027] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.350027] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.350027] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.360654] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 855.390511] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.390511] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.390511] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.390765] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.391463] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.391463] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.391463] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.391984] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.392159] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca0ea8c0-01be-4a0b-9d27-0575b9d29e07',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.471580] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.894910] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.895348] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.895514] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.895850] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.896043] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.896223] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port ca0ea8c0-01be-4a0b-9d27-0575b9d29e07 not found, creating... [ 855.896529] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.896699] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.896815] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.897086] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.897230] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.897526] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.897707] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.897869] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.898242] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.898242] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.898356] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: ca0ea8c0-01be-4a0b-9d27-0575b9d29e07 is going to be created. [ 855.919962] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.920257] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.920540] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.920638] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.920945] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.921169] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.973749] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.475818] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.476196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.476196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.476772] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.476772] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.476772] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 856.508072] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.508295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.508295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.508621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.508775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.518419] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 856.637695] env[65992]: INFO networking_nsxv3.common.synchronization [req-273cf791-9cbe-436c-b2fa-6f2c03a7229c req-39b58a4d-6e8a-470d-bfee-16befd75a1fc service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 856.637918] env[65992]: INFO networking_nsxv3.common.synchronization [req-273cf791-9cbe-436c-b2fa-6f2c03a7229c req-39b58a4d-6e8a-470d-bfee-16befd75a1fc service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 856.638269] env[65992]: INFO networking_nsxv3.common.synchronization [req-273cf791-9cbe-436c-b2fa-6f2c03a7229c req-39b58a4d-6e8a-470d-bfee-16befd75a1fc service nova] Enqueued Resource ID: ca0ea8c0-01be-4a0b-9d27-0575b9d29e07 with Priority: HIGHEST for action port [ 856.640627] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 856.640627] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 856.640627] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca0ea8c0-01be-4a0b-9d27-0575b9d29e07 with Priority: HIGHEST for action port [ 856.640627] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.640627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.640627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.640627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.640627] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.644505] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.644505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.644505] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.644505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.644505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.644505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.644505] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca0ea8c0-01be-4a0b-9d27-0575b9d29e07',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.793215] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 856.793358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.145853] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.146061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.146179] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca0ea8c0-01be-4a0b-9d27-0575b9d29e07 with status ACTIVE [ 857.146353] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.146466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.146531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.146748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.146839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.147040] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.147123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.147175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.147371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.147422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.147563] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.147657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.147708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.147916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.147963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.148037] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca0ea8c0-01be-4a0b-9d27-0575b9d29e07 is going to be updated. [ 857.169989] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.170337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.170386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.170659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.170821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.170988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca0ea8c0-01be-4a0b-9d27-0575b9d29e07" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.373279] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 857.373279] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 deletion is rescheduled due to dependency. [ 857.373279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.595018] env[65992]: INFO networking_nsxv3.common.synchronization [req-4e5adbeb-1d1b-456b-8d09-307ec056a05d req-ddc41caa-7110-41a4-8905-fec108c729a5 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 857.595857] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 857.595857] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.596033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.596033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.596203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.596355] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.597057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.597057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.597057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.597057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.597057] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.903265] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.903476] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-411" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.903601] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-411" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.903964] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-411" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.904760] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.904949] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.906137] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.906467] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.906638] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.906858] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.906974] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.907097] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.907205] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.907536] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.907536] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.907536] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.927483] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.927653] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.927841] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.928055] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-411" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.928393] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-9676aaa6-f591-4917-85b1-c75c0788d437 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.928611] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.928733] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.929100] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.929374] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9676aaa6-f591-4917-85b1-c75c0788d437',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.099373] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.099571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.099679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.099905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.099998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.100224] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.100324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.100380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.100528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.100602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.100683] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 already deleted. [ 858.100762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.431783] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.432028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.432807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.432807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.432807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.432807] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 9676aaa6-f591-4917-85b1-c75c0788d437 not found, creating... [ 858.433324] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.433324] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.433324] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.433451] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.433624] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.433825] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.433973] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.434102] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.434315] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.434445] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.434591] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 9676aaa6-f591-4917-85b1-c75c0788d437 is going to be created. [ 858.460285] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.460285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.460285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.460623] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.460865] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.461289] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.547026] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 858.547026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.547026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.547026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.547026] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.547026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.547026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.547026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.547026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.547026] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.053627] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.142684] env[65992]: INFO networking_nsxv3.common.synchronization [req-4e5adbeb-1d1b-456b-8d09-307ec056a05d req-06c6677a-3bc9-4739-b977-0cc3b711026a service nova] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 859.142857] env[65992]: INFO networking_nsxv3.common.synchronization [req-4e5adbeb-1d1b-456b-8d09-307ec056a05d req-06c6677a-3bc9-4739-b977-0cc3b711026a service nova] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 859.142992] env[65992]: INFO networking_nsxv3.common.synchronization [req-4e5adbeb-1d1b-456b-8d09-307ec056a05d req-06c6677a-3bc9-4739-b977-0cc3b711026a service nova] Enqueued Resource ID: 9676aaa6-f591-4917-85b1-c75c0788d437 with Priority: HIGHEST for action port [ 859.143506] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 859.144145] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 859.144145] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9676aaa6-f591-4917-85b1-c75c0788d437 with Priority: HIGHEST for action port [ 859.144491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.144666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.144767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.145060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.145197] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.146334] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.148799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.148893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.151059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.151059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.151059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.151059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.151059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.151059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.151059] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.151059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9676aaa6-f591-4917-85b1-c75c0788d437 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.153196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.153283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.153448] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.153528] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9676aaa6-f591-4917-85b1-c75c0788d437',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.556741] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.655266] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.656602] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.656602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.659520] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9676aaa6-f591-4917-85b1-c75c0788d437 with status ACTIVE [ 859.659520] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.659520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.659520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.659814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.659814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.659977] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.660115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.660162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.660290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.660359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.660543] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.660636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.660685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.660893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.660986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.661084] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9676aaa6-f591-4917-85b1-c75c0788d437 is going to be updated. [ 859.683727] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.683727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.683727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.683727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.683727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.684068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.062028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.062028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.062028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.062028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.062478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.062478] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 860.093045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.093219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.093289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.093490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.093630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.103365] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 860.158619] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.660856] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.663578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.663578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.663578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.663578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.663578] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be created. [ 860.696547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.696795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.697139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.697242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.697384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.708677] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: UNINITIALIZED for 2s [ 862.116113] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 862.116569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.116945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.117131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.117500] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.117617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.117695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.117878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.117961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.118061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.118154] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.153337] env[65992]: INFO networking_nsxv3.common.synchronization [req-d33ca099-b0b1-4f75-afc9-d2b46a246b98 req-d8cf36ba-5d32-4ec7-977d-5400050178b0 tempest-ServersNegativeTestMultiTenantJSON-1550755263 tempest-ServersNegativeTestMultiTenantJSON-1550755263-project-member] Enqueued Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGHEST for action security_group_members [ 862.154220] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGHEST for action security_group_members [ 862.154436] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9344356d-cfd9-4f69-96db-d4a162e98dce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.154596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.154686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.155011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.155255] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.155407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.155591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.156344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.156344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.156344] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.551658] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.551959] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-413" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.553258] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-413" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.553258] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-413" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.553703] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.553974] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.554126] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.554374] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.554515] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.554723] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.554829] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.554931] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.555044] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.555314] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.555314] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.555466] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.577647] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.577796] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.578103] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.578273] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-413" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.578940] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.579287] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.579369] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.579722] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.579914] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.621661] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.621812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.621812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.622677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.622937] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.623223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.623356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.623577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.623677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.623750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.623928] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.624031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.624103] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.624460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.624460] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.624558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.624558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.624707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.624778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.624824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.624921] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.658738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.658857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.658924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.659159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.659240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.659427] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.659583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.659583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.659728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.659823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.659878] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9344356d-cfd9-4f69-96db-d4a162e98dce already deleted. [ 862.659957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.720480] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 862.720908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.721124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.721351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.721548] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.721667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.721732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.722101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.722225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.722365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.722451] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.082818] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.082818] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.082818] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.083223] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.083331] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.083539] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e not found, creating... [ 863.083873] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.084085] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.084264] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.084526] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.084671] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.084950] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.085118] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.085250] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.085476] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.085608] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.085743] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e is going to be created. [ 863.108327] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.108650] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.108842] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.109221] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.109576] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.109912] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.127717] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6417014f-241b-4b36-8b7b-aeef9e200013: rpc.has_security_group_logging(os_id): False [ 863.148283] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.148541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.148604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.148825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.148954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.149204] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.149349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.149449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.149727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.149819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.150039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.150147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.150210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.150353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.150429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.150620] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.150731] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.150785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.150978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.151320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.151320] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 863.225872] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.226134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.226193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.226409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.226606] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.226695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.226789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.226924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.227025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.227098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.227254] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.227357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.227403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.227617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.227804] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.227916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.228043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.228163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.228983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.228983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.228983] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.235657] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.235657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.235947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.235947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.236126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.274171] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 863.731216] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7: rpc.has_security_group_logging(os_id): False [ 863.751672] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.751848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.751913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.752280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.752280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.752452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.752552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.752617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.752778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.752894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.753105] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.753442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.753442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.753442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.753684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.753684] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.753775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.753839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.753977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.754073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.754158] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be created. [ 863.837887] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.839044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.839044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.839044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.839044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.855590] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 863.915717] env[65992]: INFO networking_nsxv3.common.synchronization [req-d33ca099-b0b1-4f75-afc9-d2b46a246b98 req-0c222022-8a76-4134-b932-057233b1586b service nova] Enqueued Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGHEST for action security_group_rules [ 863.916059] env[65992]: INFO networking_nsxv3.common.synchronization [req-d33ca099-b0b1-4f75-afc9-d2b46a246b98 req-0c222022-8a76-4134-b932-057233b1586b service nova] Enqueued Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGHEST for action security_group_members [ 863.916203] env[65992]: INFO networking_nsxv3.common.synchronization [req-d33ca099-b0b1-4f75-afc9-d2b46a246b98 req-0c222022-8a76-4134-b932-057233b1586b service nova] Enqueued Resource ID: 9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e with Priority: HIGHEST for action port [ 863.917195] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGHEST for action security_group_rules [ 863.917406] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGHEST for action security_group_members [ 863.917536] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e with Priority: HIGHEST for action port [ 863.918600] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9344356d-cfd9-4f69-96db-d4a162e98dce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.918826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.918913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.919371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.919573] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.921333] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9344356d-cfd9-4f69-96db-d4a162e98dce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.921537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.921594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.921941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.922363] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.922514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.922710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.923016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.923448] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.923448] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.924550] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.924704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.924835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.925089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.925234] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.427373] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.428456] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9344356d-cfd9-4f69-96db-d4a162e98dce taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.428622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.428831] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e with status ACTIVE [ 864.429029] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.429173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.429241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.429440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.429539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.429737] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.429838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.429896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.430077] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.430153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.430333] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.430499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.430592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.430738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.430811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.430892] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e is going to be updated. [ 864.456953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.457132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.457267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.457504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.457691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.457879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e07cd80-1a37-4e1d-ad98-ec4f6a97e32e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.744093] env[65992]: INFO networking_nsxv3.common.synchronization [req-72bdc22b-8842-4731-9673-e98ad36c5dc1 req-a7d554ef-4b4c-4f87-a82d-797c3e796955 tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 864.744627] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 864.744901] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.745019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.745095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.745620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.745620] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.745620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.745620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.746205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.746205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.746205] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.933114] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.073461] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.073672] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.073801] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.074085] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.074358] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.074605] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.074605] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.074840] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.074988] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.075512] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.075697] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.075858] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.076026] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.076194] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.076412] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.076556] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.095766] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.095943] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.098895] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.098895] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.098895] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-cebc06e6-5c87-44ca-975d-5897101d5ab4 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.098895] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-cebc06e6-5c87-44ca-975d-5897101d5ab4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.098895] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-cebc06e6-5c87-44ca-975d-5897101d5ab4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.098895] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-cebc06e6-5c87-44ca-975d-5897101d5ab4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.098895] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cebc06e6-5c87-44ca-975d-5897101d5ab4',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.248085] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.248272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.248320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.248510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.248672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.248873] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.248973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.249044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.249203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.249277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.249361] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 865.296501] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 865.296791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.298501] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.298736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.299424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.299424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.299424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.310775] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 865.436474] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.436839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.436839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.437050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.437154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.437257] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9344356d-cfd9-4f69-96db-d4a162e98dce is going to be created. [ 865.464667] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.464870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.464870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.465140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.465301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.476193] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9344356d-cfd9-4f69-96db-d4a162e98dce in Status: UNINITIALIZED for 2s [ 865.600411] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.600779] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.600779] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.601087] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.601237] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.601387] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port cebc06e6-5c87-44ca-975d-5897101d5ab4 not found, creating... [ 865.601650] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.601814] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.601912] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.602145] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.602291] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.602640] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.602779] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.602894] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.603200] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.603363] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.603502] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: cebc06e6-5c87-44ca-975d-5897101d5ab4 is going to be created. [ 865.625374] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.625907] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.625907] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.626036] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.626260] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.626649] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-cebc06e6-5c87-44ca-975d-5897101d5ab4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.867438] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 865.867438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.382859] env[65992]: INFO networking_nsxv3.common.synchronization [req-72bdc22b-8842-4731-9673-e98ad36c5dc1 req-04461683-10cf-4f20-b35e-10ee94744af0 service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 866.383051] env[65992]: INFO networking_nsxv3.common.synchronization [req-72bdc22b-8842-4731-9673-e98ad36c5dc1 req-04461683-10cf-4f20-b35e-10ee94744af0 service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 866.383343] env[65992]: INFO networking_nsxv3.common.synchronization [req-72bdc22b-8842-4731-9673-e98ad36c5dc1 req-04461683-10cf-4f20-b35e-10ee94744af0 service nova] Enqueued Resource ID: cebc06e6-5c87-44ca-975d-5897101d5ab4 with Priority: HIGHEST for action port [ 866.383439] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 866.383529] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 866.383620] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cebc06e6-5c87-44ca-975d-5897101d5ab4 with Priority: HIGHEST for action port [ 866.384600] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.384700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.384838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.384943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.385044] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.385921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.386038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.386232] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-cebc06e6-5c87-44ca-975d-5897101d5ab4 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.388657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cebc06e6-5c87-44ca-975d-5897101d5ab4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.388743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cebc06e6-5c87-44ca-975d-5897101d5ab4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.388929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cebc06e6-5c87-44ca-975d-5897101d5ab4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.389018] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cebc06e6-5c87-44ca-975d-5897101d5ab4',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.892259] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.892259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.892259] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cebc06e6-5c87-44ca-975d-5897101d5ab4 with status ACTIVE [ 866.892634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.892634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.892634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.892764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.892804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.893280] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.893280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.893280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.893280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.893534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.893575] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.893692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.893741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.893878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.893962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.894059] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cebc06e6-5c87-44ca-975d-5897101d5ab4 is going to be updated. [ 866.917317] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.917551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.917551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.917822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.917984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.918173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cebc06e6-5c87-44ca-975d-5897101d5ab4" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.321056] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 867.321244] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a deletion is rescheduled due to dependency. [ 867.321344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.321509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.321740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.321931] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.322401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.322401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.322401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.322655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.322655] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.486183] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9344356d-cfd9-4f69-96db-d4a162e98dce in Status: SUCCESS [ 867.486390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.486681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.486941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.487189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.487332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.487418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.487619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.487726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.487838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.487939] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.825060] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.917490] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac40bd1f-1f11-4770-a4a9-ac5c5c02308d req-9c13788e-6e48-4f43-8c77-f066c678ef10 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 867.917963] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac40bd1f-1f11-4770-a4a9-ac5c5c02308d req-9c13788e-6e48-4f43-8c77-f066c678ef10 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 867.918633] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 867.918774] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 867.919815] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.919987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.920081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.920458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.920616] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.920724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.920724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.920943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.921310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.921310] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.922210] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.922348] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.922429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.922581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.922826] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.922921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.923132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.923362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.923362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.923362] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.981694] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac40bd1f-1f11-4770-a4a9-ac5c5c02308d req-9c13788e-6e48-4f43-8c77-f066c678ef10 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 867.981694] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac40bd1f-1f11-4770-a4a9-ac5c5c02308d req-9c13788e-6e48-4f43-8c77-f066c678ef10 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 867.981694] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac40bd1f-1f11-4770-a4a9-ac5c5c02308d req-9c13788e-6e48-4f43-8c77-f066c678ef10 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_rules [ 867.981694] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac40bd1f-1f11-4770-a4a9-ac5c5c02308d req-9c13788e-6e48-4f43-8c77-f066c678ef10 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 867.981947] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac40bd1f-1f11-4770-a4a9-ac5c5c02308d req-9c13788e-6e48-4f43-8c77-f066c678ef10 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 9676aaa6-f591-4917-85b1-c75c0788d437 with Priority: HIGHEST for action port [ 867.986357] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 867.986357] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_rules [ 867.986357] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9676aaa6-f591-4917-85b1-c75c0788d437 with Priority: HIGHEST for action port [ 867.986716] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 867.986716] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 867.989009] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.989009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.989009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.989302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.989302] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.990416] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.991819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.992165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.992458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.992545] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.994132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9676aaa6-f591-4917-85b1-c75c0788d437 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.994296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.994395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.994610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.994757] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9676aaa6-f591-4917-85b1-c75c0788d437',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.997477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.997477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.997719] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.997719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.998999] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9344356d-cfd9-4f69-96db-d4a162e98dce taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.999287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.999287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.999914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.999914] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.999914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.000124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.000180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.000567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.000567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.000567] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9344356d-cfd9-4f69-96db-d4a162e98dce taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.000567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.000788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.000788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.000898] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.001585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.001585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.001714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.001815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.001906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.002015] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.254827] env[65992]: INFO networking_nsxv3.common.synchronization [req-530a0acd-56d9-4451-8231-466dfc841461 req-5f293e57-00b6-4989-8e00-6472dfadab50 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 868.255675] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 868.257130] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.257416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.257416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.257602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.258640] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.258640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.258640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.258640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.258640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.258640] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.329426] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.410635] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 868.410902] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 868.410949] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGHEST for action security_group_members [ 868.411507] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 868.411642] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 868.411739] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGHEST for action security_group_members [ 868.412341] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.412451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.412664] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.412776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.413011] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb22631e-4990-471c-96cc-e4e5b0939818 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.413127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.413240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.413428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.413574] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.413670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.413729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.413895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.413976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.414078] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.425495] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.426243] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.463162] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 868.463162] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 868.463162] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_rules [ 868.463162] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 868.463162] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGHEST for action security_group_rules [ 868.463162] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGHEST for action security_group_members [ 868.463162] env[65992]: INFO networking_nsxv3.common.synchronization [req-9829ba16-938d-41a4-8aca-ca75c95dfa47 req-b96a6563-9e43-46f9-b1f4-efbfec3517eb tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 9676aaa6-f591-4917-85b1-c75c0788d437 with Priority: HIGHEST for action port [ 868.464159] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 868.464511] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_rules [ 868.464712] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGHEST for action security_group_members [ 868.465207] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9676aaa6-f591-4917-85b1-c75c0788d437 with Priority: HIGHEST for action port [ 868.465413] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGHEST for action security_group_rules [ 868.465598] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 868.465813] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 868.466357] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.467027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.467027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.467222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.467508] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb22631e-4990-471c-96cc-e4e5b0939818 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.467920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.470634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9676aaa6-f591-4917-85b1-c75c0788d437 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.470634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.470634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb22631e-4990-471c-96cc-e4e5b0939818 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.470634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.470634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.472489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.472489] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.473800] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.474034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.474398] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.474656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.499289] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9676aaa6-f591-4917-85b1-c75c0788d437 with status ACTIVE [ 868.499289] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.499289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.499289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.499289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.499289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.501227] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.501227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.501227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.501227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.501227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.501227] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.501610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.501610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.501688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.502137] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.502137] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9676aaa6-f591-4917-85b1-c75c0788d437 is going to be updated. [ 868.503178] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.503298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.503642] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.503752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.506586] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9344356d-cfd9-4f69-96db-d4a162e98dce: rpc.has_security_group_logging(os_id): False [ 868.527432] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.527432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.527432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.527432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.527432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.527432] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.527432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.527432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.528304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.528304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.528304] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.528304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.528304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.528304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.528304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.528714] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.528714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.528714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.528848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.528848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.528935] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9344356d-cfd9-4f69-96db-d4a162e98dce is going to be created. [ 868.531227] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.531359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.531359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.531592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.531651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.531854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.532310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.532469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.532579] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9676aaa6-f591-4917-85b1-c75c0788d437',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.599025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.599025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.599025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.599025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.599025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.620420] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9344356d-cfd9-4f69-96db-d4a162e98dce in Status: IN_PROGRESS for 2s [ 868.638198] env[65992]: INFO networking_nsxv3.common.synchronization [req-b0fa8d80-017c-46f9-90a4-0e7bbe15785c req-96b98130-b0fa-457d-a211-466d52848c31 tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 868.638198] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 868.638198] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.638393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.638393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.638702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.639678] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.639810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.639879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.640071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.640160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.640256] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.765301] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.833187] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.833404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.833449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.833833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.833833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.833833] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 868.867874] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.868061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.868133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.868433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.868491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.878690] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 868.919351] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.928659] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.929746] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.976513] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb22631e-4990-471c-96cc-e4e5b0939818 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.976659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.035272] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9676aaa6-f591-4917-85b1-c75c0788d437 with status ACTIVE [ 869.035493] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.035620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.035690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.035907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.036012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.036285] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.036285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.036354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.036483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.036571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.036761] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.036864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.037062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.037136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.037218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.037303] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9676aaa6-f591-4917-85b1-c75c0788d437 is going to be updated. [ 869.039262] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.039470] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-923" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.039619] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-923" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.039903] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-923" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.040179] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.040424] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.040542] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.040841] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.041874] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.041967] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.042084] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.042202] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.042310] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.042418] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.042530] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.042658] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.065391] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.065663] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.065831] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.066140] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-923" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.066675] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-de6b19c9-a5ab-4184-9481-41f728aa0af5 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.066832] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.066979] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.067325] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.067462] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de6b19c9-a5ab-4184-9481-41f728aa0af5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.070261] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.070261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.070261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.070261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.070261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.070261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9676aaa6-f591-4917-85b1-c75c0788d437" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.145223] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.145435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.145479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.145704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.145797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.145997] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.146121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.147027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.147027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.147745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.147745] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 already deleted. [ 869.147745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.267970] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.420715] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.432860] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.432999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.433101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.433310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.433423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.433531] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 869.434859] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.434975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.435076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.435267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.435368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.435461] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 is going to be created. [ 869.460598] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.460790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.460860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.461076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.461318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.464166] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.464305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.464374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.464574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.464708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.474573] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: UNINITIALIZED for 2s [ 869.475285] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 869.571530] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.572040] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.572251] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.572578] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.572805] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.573009] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port de6b19c9-a5ab-4184-9481-41f728aa0af5 not found, creating... [ 869.573534] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.573710] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.573710] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.574055] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.574233] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.574608] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.574807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.574928] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.575215] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.575370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.575536] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 is going to be created. [ 869.600083] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.600386] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.600546] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.600899] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.601259] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.601466] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.770541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.770760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.770844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.771201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.771306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.771404] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 869.805173] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.805372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.805469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.805758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.805928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.816187] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 869.922933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.923282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.923282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.923495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.923613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.923738] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb22631e-4990-471c-96cc-e4e5b0939818 is going to be created. [ 869.947580] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.947745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.947745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.947935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.948116] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.960453] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb22631e-4990-471c-96cc-e4e5b0939818 in Status: UNINITIALIZED for 2s [ 870.348526] env[65992]: INFO networking_nsxv3.common.synchronization [req-b0fa8d80-017c-46f9-90a4-0e7bbe15785c req-295806f8-c040-44e8-b7d4-c6bd4b113f8f service nova] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_rules [ 870.348526] env[65992]: INFO networking_nsxv3.common.synchronization [req-b0fa8d80-017c-46f9-90a4-0e7bbe15785c req-295806f8-c040-44e8-b7d4-c6bd4b113f8f service nova] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 870.348633] env[65992]: INFO networking_nsxv3.common.synchronization [req-b0fa8d80-017c-46f9-90a4-0e7bbe15785c req-295806f8-c040-44e8-b7d4-c6bd4b113f8f service nova] Enqueued Resource ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 with Priority: HIGHEST for action port [ 870.349197] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_rules [ 870.349590] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 870.349590] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 with Priority: HIGHEST for action port [ 870.350104] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.350169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.350199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.350562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.350666] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.352198] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.352345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.352401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.352615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.352779] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.352872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.352930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.353416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.353416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.353416] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.354473] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-de6b19c9-a5ab-4184-9481-41f728aa0af5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.354473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.354473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.354680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.354680] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de6b19c9-a5ab-4184-9481-41f728aa0af5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.632855] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9344356d-cfd9-4f69-96db-d4a162e98dce in Status: SUCCESS [ 870.632855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.860042] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.860042] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.860042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.860042] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de6b19c9-a5ab-4184-9481-41f728aa0af5 with status ACTIVE [ 870.860042] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.860042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.860042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.860523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.861356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.861356] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.861356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.861356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.863472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.863752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.863965] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.864076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.864137] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.864577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.864577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.864577] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 is going to be updated. [ 870.892154] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 870.892154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.892154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.892154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.892154] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.892154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.892154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.892154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.892154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.892154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.892154] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.895337] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.895460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.895570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.896091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.896091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.896913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.223243] env[65992]: INFO networking_nsxv3.common.synchronization [req-bf330917-9bb6-4c3d-985a-2618b775253d req-98994331-8543-4801-a4cd-bc78ca9e54e9 tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 871.227527] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 871.228288] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.228456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.228535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.228878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.229123] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.229235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.229308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.229482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.229614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.229759] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.368612] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.399688] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.399688] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.399688] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.399688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.400209] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.400209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.400209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.400294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.400365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.400499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.400547] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.491764] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 871.492036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.492887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.492887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.492887] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.492887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.492887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.493181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.493181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.493181] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.494857] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: SUCCESS [ 871.495102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.495251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.495397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.495618] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.495750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.495750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.495896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.495988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.496077] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.733524] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.733524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.733524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.733793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.733822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.734204] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.734286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.734286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.734450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.734529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.734617] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 871.741058] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.741058] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.741058] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.741396] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.741468] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.741631] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.741745] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.741998] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.742160] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.742371] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.742478] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.742615] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.742726] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.742833] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.742986] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.743273] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.767929] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.768136] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.768343] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.768586] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.768915] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.769206] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.769385] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.769843] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.770081] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3f651fb-7c8b-444f-ace2-6b1cfc81c29b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.773717] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.773864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.773934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.775751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.775751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.788624] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 871.827649] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 871.827868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.876417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.876810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.876996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.877375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.877612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.877745] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be created. [ 871.908211] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.908377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.908438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.908729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.909471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.912094] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 246ce419-a7b7-4e23-8bd8-c4c071ac447a: rpc.has_security_group_logging(os_id): False [ 871.934360] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: UNINITIALIZED for 2s [ 871.938576] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.938776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.938861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.939202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.939349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.940751] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.940751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.940751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.940751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.940751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.940751] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.940751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.940751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.940751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.941337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.943717] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.944080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.944080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.944080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.944162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.946037] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 871.980959] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb22631e-4990-471c-96cc-e4e5b0939818 in Status: SUCCESS [ 871.981317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.981519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.981758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.981964] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.982112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.982357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.982754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.982895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.983138] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.999211] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.000115] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.069958] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.070153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.070226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.070434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.070576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.100965] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 872.274862] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.274862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.274862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.274862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.274862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.274862] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port a3f651fb-7c8b-444f-ace2-6b1cfc81c29b not found, creating... [ 872.274862] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.274862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.274862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.274862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.274862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.275809] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.275809] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.275809] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.275809] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.275809] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.275985] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: a3f651fb-7c8b-444f-ace2-6b1cfc81c29b is going to be created. [ 872.307646] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.307902] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.308069] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.308423] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.308700] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.308953] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.485626] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.500810] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.502080] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.988667] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.003612] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.003764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.004021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.004101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.004170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.004265] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 873.009503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.009503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.009700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.009809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.009966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.010168] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 is going to be updated. [ 873.028636] env[65992]: INFO networking_nsxv3.common.synchronization [req-bf330917-9bb6-4c3d-985a-2618b775253d req-81882781-8d39-402c-b776-6d88bf780531 service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 873.028874] env[65992]: INFO networking_nsxv3.common.synchronization [req-bf330917-9bb6-4c3d-985a-2618b775253d req-81882781-8d39-402c-b776-6d88bf780531 service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 873.030251] env[65992]: INFO networking_nsxv3.common.synchronization [req-bf330917-9bb6-4c3d-985a-2618b775253d req-81882781-8d39-402c-b776-6d88bf780531 service nova] Enqueued Resource ID: a3f651fb-7c8b-444f-ace2-6b1cfc81c29b with Priority: HIGHEST for action port [ 873.030971] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 873.031164] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 873.031260] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3f651fb-7c8b-444f-ace2-6b1cfc81c29b with Priority: HIGHEST for action port [ 873.031590] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.031737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.031804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.035440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.035440] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.035440] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.035440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.035440] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.035440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.035440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.035440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.035440] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3f651fb-7c8b-444f-ace2-6b1cfc81c29b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.049597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.049846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.049916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.050590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.050590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.057058] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.057058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.057058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.057058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.057058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.070952] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 873.070952] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: IN_PROGRESS for 2s [ 873.492034] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.492034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.492034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.492427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.493316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.494043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb22631e-4990-471c-96cc-e4e5b0939818 is going to be updated. [ 873.528374] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.528655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.528762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.529188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.529338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.536230] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.536422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.536572] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3f651fb-7c8b-444f-ace2-6b1cfc81c29b with status ACTIVE [ 873.536750] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.536912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.536912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.538342] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.538342] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.538342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.538979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.538979] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3f651fb-7c8b-444f-ace2-6b1cfc81c29b is going to be updated. [ 873.541170] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb22631e-4990-471c-96cc-e4e5b0939818 in Status: IN_PROGRESS for 2s [ 873.562362] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.562681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.562681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.563247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.563247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.563247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3f651fb-7c8b-444f-ace2-6b1cfc81c29b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.800734] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 873.801027] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 873.801145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.801339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.801601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.801776] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.801895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.801962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.802132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.802212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.802317] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.828650] env[65992]: INFO networking_nsxv3.common.synchronization [req-9b1d8e8e-03ef-4e94-bebc-068f1ceb5a3b req-42a4537c-30d5-47b2-93fc-6f55ff3943bf tempest-ServersTestBootFromVolume-1851510878 tempest-ServersTestBootFromVolume-1851510878-project-member] Enqueued Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_members [ 873.829184] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGHEST for action security_group_members [ 873.829583] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.829775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.829775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.829979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.830146] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.830237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.830299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.830450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.830556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.830611] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.944271] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 873.944509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.944678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.944922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.945129] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.945285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.945360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.945530] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.945592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.945691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.945954] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.982655] env[65992]: INFO networking_nsxv3.common.synchronization [req-a318d287-dbf8-4a45-974e-b2cd0a833733 req-02f5ddb3-5229-41d8-b656-b2cf31ef3e37 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 873.983351] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 873.983438] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.983556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.983622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.983846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.984424] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.984595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.984649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.984819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.984892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.984991] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.116696] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 874.116935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.304639] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.332663] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.332849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.332884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.333118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.333206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.333400] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.333498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.333560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.333718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.333794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.333881] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 is going to be updated. [ 874.349553] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.349553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.349553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.349553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.349553] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.349553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.349553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.349932] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.349967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.350241] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.350367] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.350482] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.350589] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.350694] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.350792] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.350919] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.372281] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.372450] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 874.372593] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.372761] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.373092] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-549ef3ec-89f7-4227-beac-0ed87f6c78f1 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.373268] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-549ef3ec-89f7-4227-beac-0ed87f6c78f1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.373384] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-549ef3ec-89f7-4227-beac-0ed87f6c78f1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.373724] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-549ef3ec-89f7-4227-beac-0ed87f6c78f1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.373856] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('549ef3ec-89f7-4227-beac-0ed87f6c78f1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.375909] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.376043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.376113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.376286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.376417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.385996] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 in Status: IN_PROGRESS for 2s [ 874.447846] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.448040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.448087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.448301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.448459] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.448595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.448697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.448857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.448942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.449046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.452518] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.452518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.452518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.452518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.452518] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.452518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.452518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.452518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.452518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.452518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.452518] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.487077] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.487238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.487311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.487541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.487631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.487826] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.487951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.488013] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.488158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.488231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.488315] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 874.518741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.519070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.519070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.519173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.519313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.530787] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 874.808017] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.878849] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.879214] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.879315] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.879652] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.879796] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.879990] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 549ef3ec-89f7-4227-beac-0ed87f6c78f1 not found, creating... [ 874.880298] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.880461] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.880603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.880829] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.880989] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.881289] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.881444] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.881559] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.881848] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.882028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.882187] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 549ef3ec-89f7-4227-beac-0ed87f6c78f1 is going to be created. [ 874.903577] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.903859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.903937] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.905238] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.905238] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.905238] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-549ef3ec-89f7-4227-beac-0ed87f6c78f1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.951914] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8: rpc.has_security_group_logging(os_id): False [ 874.984535] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.984535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.984535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.984535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.984535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.984535] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.984808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.984808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.984808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.984935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.985057] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.985200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.985200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.985364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.985436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.985705] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.985831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.985896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.986117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.986166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.986299] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be created. [ 875.092677] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 875.093011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.093674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.093909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.094189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.094316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.094379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.094694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.094824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.094942] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.098261] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.098261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.098261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.098641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.098790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.101363] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: SUCCESS [ 875.101363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.102076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.102804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.102804] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.102804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.102804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.103067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.103106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.103232] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.117693] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: IN_PROGRESS for 2s [ 875.311377] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.311589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.311626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.311842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.311924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.312034] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 875.349868] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.350142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.350142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.350369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.350570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.360330] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 875.555761] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb22631e-4990-471c-96cc-e4e5b0939818 in Status: SUCCESS [ 875.556084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.556152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.556365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.556551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.556699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.556769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.556911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.556999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.557122] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.557210] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.598956] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.606923] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.665966] env[65992]: INFO networking_nsxv3.common.synchronization [req-a318d287-dbf8-4a45-974e-b2cd0a833733 req-1f2d09a4-4907-4327-85b4-1bcc6ef542ff service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 875.666208] env[65992]: INFO networking_nsxv3.common.synchronization [req-a318d287-dbf8-4a45-974e-b2cd0a833733 req-1f2d09a4-4907-4327-85b4-1bcc6ef542ff service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 875.666347] env[65992]: INFO networking_nsxv3.common.synchronization [req-a318d287-dbf8-4a45-974e-b2cd0a833733 req-1f2d09a4-4907-4327-85b4-1bcc6ef542ff service nova] Enqueued Resource ID: 549ef3ec-89f7-4227-beac-0ed87f6c78f1 with Priority: HIGHEST for action port [ 875.667103] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 875.667280] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 875.667379] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549ef3ec-89f7-4227-beac-0ed87f6c78f1 with Priority: HIGHEST for action port [ 875.667657] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.667777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.667843] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.668215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.668289] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.671032] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.671032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.671032] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-549ef3ec-89f7-4227-beac-0ed87f6c78f1 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.671032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-549ef3ec-89f7-4227-beac-0ed87f6c78f1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.671032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-549ef3ec-89f7-4227-beac-0ed87f6c78f1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.671977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-549ef3ec-89f7-4227-beac-0ed87f6c78f1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.672096] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('549ef3ec-89f7-4227-beac-0ed87f6c78f1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.062963] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.101317] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.108949] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.173974] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.174507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.174848] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 549ef3ec-89f7-4227-beac-0ed87f6c78f1 with status ACTIVE [ 876.175138] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.175269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.175335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.175543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.175667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.175952] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.176079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.176140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.176571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.178329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.178329] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.178329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.178329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.178329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.178329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.178329] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 549ef3ec-89f7-4227-beac-0ed87f6c78f1 is going to be updated. [ 876.206734] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.206900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.207072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.207232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.207955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.207955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-549ef3ec-89f7-4227-beac-0ed87f6c78f1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.398309] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 in Status: SUCCESS [ 876.398487] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 deletion is rescheduled due to dependency. [ 876.398702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.549186] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 876.549476] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 876.549664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.554157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.554157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.554157] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.554157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.554157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.554157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.554157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.554157] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.565276] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb22631e-4990-471c-96cc-e4e5b0939818: rpc.has_security_group_logging(os_id): False [ 876.595748] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.597072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.597072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.597072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.597072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.597072] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.597396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.597396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.597466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.597510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.597646] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb22631e-4990-471c-96cc-e4e5b0939818 is going to be created. [ 876.606337] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.606337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.606337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.606575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.606880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.606880] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 876.612033] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.612230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.612303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.612535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.612639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.613303] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 is going to be updated. [ 876.649506] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.649787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.649906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.650856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.650856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.654326] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.654326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.654326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.654834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.655152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.676444] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.676444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.676444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.676817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.676953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.680055] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 876.680629] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: IN_PROGRESS for 2s [ 876.693474] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb22631e-4990-471c-96cc-e4e5b0939818 in Status: IN_PROGRESS for 2s [ 877.058561] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.139172] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 877.141349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.371277] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 877.371435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.371614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.371867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.372340] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.372340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.372340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.372558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.372558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.372641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.372707] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.437445] env[65992]: INFO networking_nsxv3.common.synchronization [req-26813cc4-de8f-45f5-8a39-eb5df7cf4179 req-0cb8b934-7f82-48e8-b762-c8ed7431e221 tempest-ServersNegativeTestMultiTenantJSON-1550755263 tempest-ServersNegativeTestMultiTenantJSON-1550755263-project-member] Enqueued Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGHEST for action security_group_members [ 877.441021] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGHEST for action security_group_members [ 877.441021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9344356d-cfd9-4f69-96db-d4a162e98dce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.441021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.441021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.441021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.441021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.441021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.441021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.441021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.441021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.441021] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.561898] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.878100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.878100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.878100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.878100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.878100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.879647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.879647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.879647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.879647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.879647] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.942292] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.942812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.942897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.944298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.944298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.944298] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.944298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.944298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.944298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.944298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.944298] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9344356d-cfd9-4f69-96db-d4a162e98dce is going to be updated. [ 877.982474] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.982646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.982690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.982886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.983088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.993710] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9344356d-cfd9-4f69-96db-d4a162e98dce in Status: IN_PROGRESS for 2s [ 878.064280] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.064449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.064522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.064756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.064865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.065193] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 878.113275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.113454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.113495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.113702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.114271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.124132] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 878.382399] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6866765e-0cdc-4d35-aa21-1b0f99339ef0: rpc.has_security_group_logging(os_id): False [ 878.405253] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.405457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.405555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.405793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.405937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.406229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.407065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.407065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.407065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.407065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.407065] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.407443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.407443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.407443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.407443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.407640] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.409047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.409047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.409047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.409047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.409047] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 878.495949] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.496134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.496188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.496394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.497319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.529987] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 878.692383] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: SUCCESS [ 878.692610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.692791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.693015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.693209] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.693333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.693389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.693553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.693633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.693727] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.695337] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 878.695509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.696537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.696722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.696898] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.697019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.697080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.697224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.697300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.697390] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.708521] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb22631e-4990-471c-96cc-e4e5b0939818 in Status: SUCCESS [ 878.708842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.199542] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.200614] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.410521] env[65992]: INFO networking_nsxv3.common.synchronization [req-431b9cd6-5548-42ee-8ec0-b3ada272f036 req-068b9b71-83be-45a0-a262-74f5de9fd9e5 tempest-AttachVolumeTestJSON-243931194 tempest-AttachVolumeTestJSON-243931194-project-member] Enqueued Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_members [ 879.411091] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_members [ 879.411400] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.411524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.411592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.411880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.412281] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.412451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.412539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.412730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.413262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.414319] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.628877] env[65992]: INFO networking_nsxv3.common.synchronization [None req-6247f2d1-e710-4b4d-98dd-60a0bda6bf86 None None] Enqueued Resource ID: ec76d2d3-3252-47e1-b1be-0e2faa71aeb0 with Priority: HIGHEST for action port [ 879.629613] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec76d2d3-3252-47e1-b1be-0e2faa71aeb0 with Priority: HIGHEST for action port [ 879.631727] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec76d2d3-3252-47e1-b1be-0e2faa71aeb0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.631889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec76d2d3-3252-47e1-b1be-0e2faa71aeb0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.632155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec76d2d3-3252-47e1-b1be-0e2faa71aeb0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.632230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec76d2d3-3252-47e1-b1be-0e2faa71aeb0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.632306] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec76d2d3-3252-47e1-b1be-0e2faa71aeb0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.703013] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.703733] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.874976] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.876797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-774" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.876797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-774" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.876797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-774" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.876797] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.876797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.876797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.876797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.876797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.877287] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.877287] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.877287] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.877287] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.877463] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.877508] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.878153] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.897354] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.897561] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.897663] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.898092] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-774" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.898293] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-cddd1ae4-ba90-46c8-a4e9-57349964a547 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.898460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-cddd1ae4-ba90-46c8-a4e9-57349964a547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.898604] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-cddd1ae4-ba90-46c8-a4e9-57349964a547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.898961] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-cddd1ae4-ba90-46c8-a4e9-57349964a547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.899126] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cddd1ae4-ba90-46c8-a4e9-57349964a547',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.918951] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.918951] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.918951] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 already deleted. [ 879.918951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.005893] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9344356d-cfd9-4f69-96db-d4a162e98dce in Status: SUCCESS [ 880.005893] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9344356d-cfd9-4f69-96db-d4a162e98dce deletion is rescheduled due to dependency. [ 880.005893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.136307] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec76d2d3-3252-47e1-b1be-0e2faa71aeb0 [ 880.136307] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.136307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.136584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.136783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.136783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.137504] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec76d2d3-3252-47e1-b1be-0e2faa71aeb0 already deleted. [ 880.137504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec76d2d3-3252-47e1-b1be-0e2faa71aeb0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.138129] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 880.138327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.138533] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.138763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.139437] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.139437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.139437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.139682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.139682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.139808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.139920] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.206054] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.206345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.206524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.206694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.206950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.206950] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 880.208255] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.208363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.208427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.208611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.208735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.208845] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 is going to be updated. [ 880.239180] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.239341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.239397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.239578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.239773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.241903] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.242042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.242183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.242321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.242503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.254760] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: IN_PROGRESS for 2s [ 880.255363] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 880.404222] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.404222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.404222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.404222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.404222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.404222] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port cddd1ae4-ba90-46c8-a4e9-57349964a547 not found, creating... [ 880.404222] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.404222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.404222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.404222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.404222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.404551] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.404551] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.404551] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.404551] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.404918] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.405229] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: cddd1ae4-ba90-46c8-a4e9-57349964a547 is going to be created. [ 880.430071] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.430821] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.430821] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.431045] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.431183] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.431475] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-cddd1ae4-ba90-46c8-a4e9-57349964a547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.587425] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 880.587703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.647119] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.647119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.647119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.647499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.647593] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.647709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.647776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.647957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.648089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.648242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.648662] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.648781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.648781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.648932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.649103] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.649203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.649251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.649405] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.649478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.649558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.649680] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.159181] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a7f9db-1203-43be-8fe2-0b76907a767d: rpc.has_security_group_logging(os_id): False [ 881.195339] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.195589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.195646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.196055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.196055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.196318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.196318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.196487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.196645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.196645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.196855] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.196952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.197026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.197923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.198047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.198270] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.198371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.198463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.198585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.198691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.198800] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 881.200840] env[65992]: INFO networking_nsxv3.common.synchronization [req-431b9cd6-5548-42ee-8ec0-b3ada272f036 req-4f0badeb-7a1a-482e-9e65-7f114a37ed19 service nova] Enqueued Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_rules [ 881.201041] env[65992]: INFO networking_nsxv3.common.synchronization [req-431b9cd6-5548-42ee-8ec0-b3ada272f036 req-4f0badeb-7a1a-482e-9e65-7f114a37ed19 service nova] Enqueued Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_members [ 881.201194] env[65992]: INFO networking_nsxv3.common.synchronization [req-431b9cd6-5548-42ee-8ec0-b3ada272f036 req-4f0badeb-7a1a-482e-9e65-7f114a37ed19 service nova] Enqueued Resource ID: cddd1ae4-ba90-46c8-a4e9-57349964a547 with Priority: HIGHEST for action port [ 881.201820] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_rules [ 881.201955] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_members [ 881.202089] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddd1ae4-ba90-46c8-a4e9-57349964a547 with Priority: HIGHEST for action port [ 881.202893] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.203013] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.203066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.203315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.203402] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.204491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.204821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.204821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.205363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.206390] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.206390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.206390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.206390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.206390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.206390] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.207136] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-cddd1ae4-ba90-46c8-a4e9-57349964a547 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.208563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cddd1ae4-ba90-46c8-a4e9-57349964a547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.208696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cddd1ae4-ba90-46c8-a4e9-57349964a547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.209206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cddd1ae4-ba90-46c8-a4e9-57349964a547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.209301] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cddd1ae4-ba90-46c8-a4e9-57349964a547',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.322041] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.322352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.322519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.322948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.326020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.376504] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 881.711707] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.718486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.718486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.718486] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cddd1ae4-ba90-46c8-a4e9-57349964a547 with status ACTIVE [ 881.718486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.718486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.718486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.718486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.718486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.718486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.718486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.719269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.719542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.719789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.720106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.720341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.722259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.722259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.722259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.722259] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cddd1ae4-ba90-46c8-a4e9-57349964a547 is going to be updated. [ 881.748305] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.748305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.748305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.748305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.748305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.748305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cddd1ae4-ba90-46c8-a4e9-57349964a547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.819785] env[65992]: INFO networking_nsxv3.common.synchronization [req-7227c1e5-224b-4f52-8ba0-ba18c8fbb8a0 req-166e6f50-1d1c-4af1-b6c3-4fcd43696987 tempest-ServersV294TestFqdnHostnames-2052689092 tempest-ServersV294TestFqdnHostnames-2052689092-project-member] Enqueued Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_members [ 881.823023] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436e4ee0-1cae-4512-b766-d84853476f90 with Priority: HIGHEST for action security_group_members [ 881.823023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-436e4ee0-1cae-4512-b766-d84853476f90 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.823023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.823023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.823023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.823023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.823023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.823023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.823023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.823023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.823023] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('436e4ee0-1cae-4512-b766-d84853476f90',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.119536] env[65992]: INFO networking_nsxv3.common.synchronization [None req-daf6261f-961e-457a-8eac-32b0c50a83e8 None None] Enqueued Resource ID: dbdc3819-cafb-4b8e-982d-aae6a8130a97 with Priority: HIGHEST for action port [ 882.120358] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbdc3819-cafb-4b8e-982d-aae6a8130a97 with Priority: HIGHEST for action port [ 882.120885] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbdc3819-cafb-4b8e-982d-aae6a8130a97 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.120885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbdc3819-cafb-4b8e-982d-aae6a8130a97" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.120885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbdc3819-cafb-4b8e-982d-aae6a8130a97" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.122753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbdc3819-cafb-4b8e-982d-aae6a8130a97" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.122827] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbdc3819-cafb-4b8e-982d-aae6a8130a97',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.218310] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.276340] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.276340] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: SUCCESS [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.276340] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.276340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.276340] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.277030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.277145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.277318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.277431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.277480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.277650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.277785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.277926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.278046] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.324946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.325188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.325247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.326140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.351049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.351049] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.351049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.351049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.351049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.351049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.351049] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 436e4ee0-1cae-4512-b766-d84853476f90 is going to be updated. [ 882.397042] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.397042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.397042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.397424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.397424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.404524] env[65992]: INFO networking_nsxv3.common.synchronization [None req-ea34d760-38b6-447c-a397-43b81e8978e3 tempest-AttachVolumeShelveTestJSON-1466192988 tempest-AttachVolumeShelveTestJSON-1466192988-project-member] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_rules [ 882.405390] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_rules [ 882.405390] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.405661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.405661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.405830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.406073] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.413021] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 436e4ee0-1cae-4512-b766-d84853476f90 in Status: IN_PROGRESS for 2s [ 882.627729] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbdc3819-cafb-4b8e-982d-aae6a8130a97 [ 882.627964] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.628201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.628309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.628747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.628747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.628912] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbdc3819-cafb-4b8e-982d-aae6a8130a97 already deleted. [ 882.628959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbdc3819-cafb-4b8e-982d-aae6a8130a97" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.725070] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.725070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.725276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.725359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.725449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.725549] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 is going to be created. [ 882.756426] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.756592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.756639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.756887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.757075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.768681] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 in Status: UNINITIALIZED for 2s [ 882.781081] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.781203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.781287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.781571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.781771] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.781932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.782327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.782327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.782327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.782422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.782541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.782658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.782817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.782991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.783226] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.783355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.783497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.783652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.783763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.783883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.783997] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.785412] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.881963] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e8bce31f-cf1f-48d8-a428-1a441ecc80a9 tempest-AttachVolumeShelveTestJSON-1466192988 tempest-AttachVolumeShelveTestJSON-1466192988-project-member] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_rules [ 882.882915] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_rules [ 882.887218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.887365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.929783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.929984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.930089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.930261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.930355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.930500] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a already deleted. [ 882.930545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.931145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.931434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.931434] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.143555] env[65992]: INFO networking_nsxv3.common.synchronization [req-6325d295-ba29-48d9-ba39-95b2bd275595 req-cdf7718c-9d56-4f32-91d7-2555ea7a46f6 tempest-ListServersNegativeTestJSON-2099661029 tempest-ListServersNegativeTestJSON-2099661029-project-member] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 883.144261] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 883.144604] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.144788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.144788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.145175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.145424] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.146101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.146101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.146101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.146101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.146101] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.287318] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7: rpc.has_security_group_logging(os_id): False [ 883.291025] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8abc7e6f-b99b-4856-9c2c-59b9b0971df3: rpc.has_security_group_logging(os_id): False [ 883.321994] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.322432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.322562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.323918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.324131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.326437] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.326437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.326437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.326437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.326749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.326785] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 is going to be created. [ 883.330438] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.330619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.330733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.331046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.331182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.331423] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.331610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.331721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.333085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.333085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.333085] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.333085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.333085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.333304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.333396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.333670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.333836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.333936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.336074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.336074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.336074] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 883.390213] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 883.390213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.425946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.426163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.426232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.426397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.426641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.458570] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: IN_PROGRESS for 2s [ 883.458570] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.458570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.458570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.459038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.459038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.461436] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.461436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.461436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.462550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.462550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.462550] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a already deleted. [ 883.462550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.498364] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 883.649617] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.153596] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.425402] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 436e4ee0-1cae-4512-b766-d84853476f90 in Status: SUCCESS [ 884.425668] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 436e4ee0-1cae-4512-b766-d84853476f90 deletion is rescheduled due to dependency. [ 884.425859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-436e4ee0-1cae-4512-b766-d84853476f90" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.656200] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.656830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.659331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.659331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.659331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.659331] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 884.691494] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.691832] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.692037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.692345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.693868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.703508] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 884.780444] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 in Status: SUCCESS [ 884.780722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.781192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.781192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.781379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.781702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.781702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.781924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.781924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.781924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.783617] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.887117] env[65992]: INFO networking_nsxv3.common.synchronization [req-ab62f500-2a24-4c58-b0b1-f521aa53757f req-3901f25b-5d3e-4d33-8e9e-ae01f5804890 tempest-ListServersNegativeTestJSON-2099661029 tempest-ListServersNegativeTestJSON-2099661029-project-member] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 884.887740] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGHEST for action security_group_members [ 884.890294] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.890294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.289429] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.474590] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: SUCCESS [ 885.474986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.475202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.477066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.477066] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.515456] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 885.515727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.516079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.516288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.516402] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.792493] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9ae5db7-375e-4a37-a1a9-1b791ce8df64: rpc.has_security_group_logging(os_id): False [ 885.820025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.820025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.820025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.820025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.820025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.820025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.820025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.820025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.820025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.820025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.820025] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 is going to be created. [ 885.845198] env[65992]: INFO networking_nsxv3.common.synchronization [req-289fbcd6-c21d-4484-8192-536d90a686f5 req-c02b0ead-9f05-494b-a28f-10bdeb15512d tempest-ServersAdminTestJSON-561694848 tempest-ServersAdminTestJSON-561694848-project-member] Enqueued Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 885.845876] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 with Priority: HIGHEST for action security_group_members [ 885.847948] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8f9dacc-af29-4b40-93c8-17d4f636d125 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.847948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.847948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.847948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.847948] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.848371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.848371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.848371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.848371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.848500] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8f9dacc-af29-4b40-93c8-17d4f636d125',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.893872] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.894083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.894174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.894385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.894562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.917320] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 in Status: IN_PROGRESS for 2s [ 885.978602] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.978805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.978899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.979113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.979322] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.979462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.979520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.979695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.979833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.979954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.980078] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.022993] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.022993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.022993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.022993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.022993] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.022993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.022993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.022993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.023389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.023389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.023389] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.350908] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.351102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.351272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.351407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.375935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.376325] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.376455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.376586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.376854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.376948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.377066] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 is going to be updated. [ 886.406135] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.406135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.406135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.406135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.406135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.416806] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: IN_PROGRESS for 2s [ 886.427140] env[65992]: INFO networking_nsxv3.common.synchronization [None req-1a9f27ff-bfc8-4946-bcb3-d44b1af96d6c tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_rules [ 886.427688] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_rules [ 886.427996] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.428381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.428452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.428753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.428836] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.483070] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.519115] env[65992]: INFO networking_nsxv3.common.synchronization [None req-a2e94cba-efa5-4dcb-92e0-334b301de90d tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_rules [ 886.519465] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_rules [ 886.519903] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.520069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.527036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.527233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.527308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.527541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.527754] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.527879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.527946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.528173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.528272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.528374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.528693] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.528754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.531619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.531619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.531619] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.531619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.531619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.531619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.531619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.531619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.531619] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.716926] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 886.718940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.718940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.721064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.721064] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.721064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.721064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.721064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.721064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.721064] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.954473] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.954644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.954730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.954978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.955089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.955222] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e35d0a29-9466-4e93-850f-29921a743936 already deleted. [ 886.955309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.955563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.955737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.955861] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.988386] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8abc7e6f-b99b-4856-9c2c-59b9b0971df3: rpc.has_security_group_logging(os_id): False [ 887.012321] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.012490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.012565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.013182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.013182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.013182] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.013365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.013365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.013477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.013552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.013639] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 is going to be updated. [ 887.033238] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7: rpc.has_security_group_logging(os_id): False [ 887.077702] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.077900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.078165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.078205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.078279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.078484] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.078583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.078686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.078820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.078895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.079180] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.079235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.079275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.079464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.079464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.079637] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.079781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.079824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.079988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.080205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.080320] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 887.148629] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.148866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.148928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.149171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.149531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.165133] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: IN_PROGRESS for 2s [ 887.191884] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.192277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.192277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.192571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.192777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.223359] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.223550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.223600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.227032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.227032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.227032] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.227032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.227032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.227032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.227032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.227032] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be updated. [ 887.251218] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 887.307085] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.307085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.307085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.307085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.307524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.318050] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: IN_PROGRESS for 2s [ 887.479545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.479545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.479797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.479923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.480064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.480169] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e35d0a29-9466-4e93-850f-29921a743936 already deleted. [ 887.480279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.933369] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 in Status: SUCCESS [ 887.933599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.154987] env[65992]: INFO networking_nsxv3.common.synchronization [req-a130273d-57e5-4fb8-9b32-863dd9e42d74 req-a545b7da-3b1c-4af4-824c-48354adf7e47 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 888.155738] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 888.156163] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.156326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.156422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.156766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.157300] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.157300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.157300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.157436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.157776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.157776] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.431241] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 in Status: SUCCESS [ 888.431241] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8f9dacc-af29-4b40-93c8-17d4f636d125 deletion is rescheduled due to dependency. [ 888.431241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8f9dacc-af29-4b40-93c8-17d4f636d125" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.660381] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.675277] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.678562] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-411" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.678900] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-411" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.680439] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-411" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.680823] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.681104] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.681279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.681552] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.681728] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.681976] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.682135] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.682269] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.682803] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.682993] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.683158] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.683350] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.704716] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.704880] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.705031] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.705770] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-411" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.705770] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.705770] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.705984] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.706158] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.706301] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3d748e-7b41-4697-85f0-6c602c7e2ecc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.162790] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.177206] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: SUCCESS [ 889.177423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.209310] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.209547] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.209672] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.209977] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.210179] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.210320] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 9f3d748e-7b41-4697-85f0-6c602c7e2ecc not found, creating... [ 889.210651] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.210817] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.211044] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.211273] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.211463] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.211757] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.211932] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.212107] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.212391] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.212780] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.213018] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc is going to be created. [ 889.234807] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.235054] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.235180] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.235471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.235740] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.235923] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.267887] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 889.267887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.338056] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 in Status: SUCCESS [ 889.338368] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 deletion is rescheduled due to dependency. [ 889.338572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.664908] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.665085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.665153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.665367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.665451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.665551] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 889.696095] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.696976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.697069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.697323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.697482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.710825] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 890.007022] env[65992]: INFO networking_nsxv3.common.synchronization [req-a130273d-57e5-4fb8-9b32-863dd9e42d74 req-55a1ea6f-945e-4ab5-a728-6ecca0cc50a3 service nova] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 890.007022] env[65992]: INFO networking_nsxv3.common.synchronization [req-a130273d-57e5-4fb8-9b32-863dd9e42d74 req-55a1ea6f-945e-4ab5-a728-6ecca0cc50a3 service nova] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 890.007022] env[65992]: INFO networking_nsxv3.common.synchronization [req-a130273d-57e5-4fb8-9b32-863dd9e42d74 req-55a1ea6f-945e-4ab5-a728-6ecca0cc50a3 service nova] Enqueued Resource ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with Priority: HIGHEST for action port [ 890.007022] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 890.007022] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 890.007022] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with Priority: HIGHEST for action port [ 890.007022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.007602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.007602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.007602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.007755] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.008570] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.008720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.008942] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.009056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.009138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.009429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.009586] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3d748e-7b41-4697-85f0-6c602c7e2ecc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.513213] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.513531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.513531] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with status ACTIVE [ 890.513720] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.513873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.513873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.514071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.514154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.514318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.514409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.514465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.514616] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.514685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.514865] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.514949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.515017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.515225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.515225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.515763] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc is going to be updated. [ 890.541907] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.542136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.542136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.542885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.542885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.542885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.722798] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 891.723299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.723299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.723441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.723623] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.723739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.723799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.723960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.724056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.724217] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.841505] env[65992]: INFO networking_nsxv3.common.synchronization [req-a1b5ad12-c1f1-4b59-95fd-ed32bde7a94e req-10f92309-b723-4333-905f-8c4c303be5af tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 891.841505] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 891.842027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.842346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.842516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.842806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.843083] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.843746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.843940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.844235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.844492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.845489] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.227039] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.347358] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.347592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.347652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.347849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.347971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.348163] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.348304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.348358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.348491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.348568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.348659] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 892.383837] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.383837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.383837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.383837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.383837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.394026] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 892.462974] env[65992]: INFO networking_nsxv3.common.synchronization [None req-317f8607-a643-4912-aed9-2b22d1bc406e None None] Enqueued Resource ID: 492d9408-bf91-48d0-9013-5a782a923281 with Priority: HIGHEST for action port [ 892.463544] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 492d9408-bf91-48d0-9013-5a782a923281 with Priority: HIGHEST for action port [ 892.463875] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-492d9408-bf91-48d0-9013-5a782a923281 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.464046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-492d9408-bf91-48d0-9013-5a782a923281" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.464111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-492d9408-bf91-48d0-9013-5a782a923281" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.464868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-492d9408-bf91-48d0-9013-5a782a923281" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.464868] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('492d9408-bf91-48d0-9013-5a782a923281',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.729045] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.967239] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 492d9408-bf91-48d0-9013-5a782a923281 [ 892.967551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.967822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.967822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.968117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.968220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.968348] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:492d9408-bf91-48d0-9013-5a782a923281 already deleted. [ 892.968463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-492d9408-bf91-48d0-9013-5a782a923281" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.234253] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.235662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.235662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.235662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.235662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.235662] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 893.264438] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.264652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.265297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.265297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.265297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.279727] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 894.392127] env[65992]: INFO networking_nsxv3.common.synchronization [req-dffcf10c-59b5-4919-830f-7f52338d7f2c req-ba535a9c-4a34-4791-8865-e2eda86a56eb tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 with Priority: HIGHEST for action security_group_members [ 894.392811] env[65992]: INFO networking_nsxv3.common.synchronization [req-dffcf10c-59b5-4919-830f-7f52338d7f2c req-ba535a9c-4a34-4791-8865-e2eda86a56eb tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 894.392851] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 with Priority: HIGHEST for action security_group_members [ 894.393065] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 894.393480] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc87cf9e-db04-4df8-82ef-bda74f4ae783 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.393792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.393792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.393925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.394057] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.394220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.394220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.394377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.394460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.394567] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.395434] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.395599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.395637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.395859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.395891] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.396058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.396058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.396184] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.396252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.396351] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.409139] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 894.409396] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 894.409469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.453741] env[65992]: INFO networking_nsxv3.common.synchronization [req-dffcf10c-59b5-4919-830f-7f52338d7f2c req-ba535a9c-4a34-4791-8865-e2eda86a56eb tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_rules [ 894.453926] env[65992]: INFO networking_nsxv3.common.synchronization [req-dffcf10c-59b5-4919-830f-7f52338d7f2c req-ba535a9c-4a34-4791-8865-e2eda86a56eb tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 894.454075] env[65992]: INFO networking_nsxv3.common.synchronization [req-dffcf10c-59b5-4919-830f-7f52338d7f2c req-ba535a9c-4a34-4791-8865-e2eda86a56eb tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 with Priority: HIGHEST for action security_group_rules [ 894.454286] env[65992]: INFO networking_nsxv3.common.synchronization [req-dffcf10c-59b5-4919-830f-7f52338d7f2c req-ba535a9c-4a34-4791-8865-e2eda86a56eb tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 with Priority: HIGHEST for action security_group_members [ 894.454364] env[65992]: INFO networking_nsxv3.common.synchronization [req-dffcf10c-59b5-4919-830f-7f52338d7f2c req-ba535a9c-4a34-4791-8865-e2eda86a56eb tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 with Priority: HIGHEST for action port [ 894.454943] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_rules [ 894.455975] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 with Priority: HIGHEST for action security_group_rules [ 894.457148] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 with Priority: HIGHEST for action port [ 894.457148] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 894.457148] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 with Priority: HIGHEST for action security_group_members [ 894.457148] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.457148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.457427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.457427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.457522] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.458539] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc87cf9e-db04-4df8-82ef-bda74f4ae783 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.458539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.458539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.458784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.458843] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.459687] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-de6b19c9-a5ab-4184-9481-41f728aa0af5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.459818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.459988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.460067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.460119] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de6b19c9-a5ab-4184-9481-41f728aa0af5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.460868] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.461075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.461525] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc87cf9e-db04-4df8-82ef-bda74f4ae783 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.461525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.899405] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.899405] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.963414] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc87cf9e-db04-4df8-82ef-bda74f4ae783 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.963740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.964184] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de6b19c9-a5ab-4184-9481-41f728aa0af5 with status ACTIVE [ 894.964694] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.964932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.965034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.965352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.965578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.965875] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.966018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.966106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.966332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.966445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.966692] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.966828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.967158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.971126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.971126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.971126] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 is going to be updated. [ 894.971126] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.971126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.996157] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.996306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.996379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.996597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.996748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.996949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.125292] env[65992]: INFO networking_nsxv3.common.synchronization [req-ffb3181a-71c2-4f8e-8221-d67bfd5d37f9 req-aad4fb70-45fd-476e-bc26-72847b86812c tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 with Priority: HIGHEST for action security_group_members [ 895.125292] env[65992]: INFO networking_nsxv3.common.synchronization [req-ffb3181a-71c2-4f8e-8221-d67bfd5d37f9 req-aad4fb70-45fd-476e-bc26-72847b86812c tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 895.126530] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 with Priority: HIGHEST for action security_group_members [ 895.126654] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 895.127235] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc87cf9e-db04-4df8-82ef-bda74f4ae783 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.127322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.127710] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.127758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.184408] env[65992]: INFO networking_nsxv3.common.synchronization [None req-0290b59d-7ef5-4578-a9a4-6d7210668ec1 None None] Enqueued Resource ID: 518b57a8-718e-459c-a4ea-450dddbaf219 with Priority: HIGHEST for action port [ 895.186117] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518b57a8-718e-459c-a4ea-450dddbaf219 with Priority: HIGHEST for action port [ 895.187546] env[65992]: INFO networking_nsxv3.common.synchronization [req-ffb3181a-71c2-4f8e-8221-d67bfd5d37f9 req-aad4fb70-45fd-476e-bc26-72847b86812c tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_rules [ 895.187803] env[65992]: INFO networking_nsxv3.common.synchronization [req-ffb3181a-71c2-4f8e-8221-d67bfd5d37f9 req-aad4fb70-45fd-476e-bc26-72847b86812c tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 895.188033] env[65992]: INFO networking_nsxv3.common.synchronization [req-ffb3181a-71c2-4f8e-8221-d67bfd5d37f9 req-aad4fb70-45fd-476e-bc26-72847b86812c tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 with Priority: HIGHEST for action port [ 895.188514] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-518b57a8-718e-459c-a4ea-450dddbaf219 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.188697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-518b57a8-718e-459c-a4ea-450dddbaf219" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.188898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-518b57a8-718e-459c-a4ea-450dddbaf219" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.189220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-518b57a8-718e-459c-a4ea-450dddbaf219" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.189352] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('518b57a8-718e-459c-a4ea-450dddbaf219',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.190863] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_rules [ 895.191076] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 895.191238] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 with Priority: HIGHEST for action port [ 895.191659] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.191802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.192689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.192803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.193187] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-de6b19c9-a5ab-4184-9481-41f728aa0af5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.193305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.193371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.193573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.193654] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de6b19c9-a5ab-4184-9481-41f728aa0af5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.295419] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 895.295740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.296166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.296462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.296756] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.297075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.297237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.297459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.297679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.297839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.297990] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.401927] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.405711] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.697719] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 518b57a8-718e-459c-a4ea-450dddbaf219 [ 895.698213] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.698626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.698822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.699135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.699359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.699495] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:518b57a8-718e-459c-a4ea-450dddbaf219 already deleted. [ 895.699652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-518b57a8-718e-459c-a4ea-450dddbaf219" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.699954] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de6b19c9-a5ab-4184-9481-41f728aa0af5 with status ACTIVE [ 895.700212] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.700362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.700442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.700691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.700816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.701396] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.701396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.701396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.701653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.701708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.702484] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.702621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.702621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.702911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.702996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.703124] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de6b19c9-a5ab-4184-9481-41f728aa0af5 is going to be updated. [ 895.735241] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.735625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.735753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.736046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.737188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.737188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de6b19c9-a5ab-4184-9481-41f728aa0af5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.811158] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.811374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.811374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.811549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.811722] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.811825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.811926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.812057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.812143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.812229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.812467] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.813208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.813208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.813208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.813428] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.813428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.813544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.813699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.813699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.813788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.813933] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.907275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.907511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.907511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.907766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.907925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.908050] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be updated. [ 895.909625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.909820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.909945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.910186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.910305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.910404] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 is going to be created. [ 895.936486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.936760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.936760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.936940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.937108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.940104] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.940303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.940436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.940524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.940684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.949785] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 in Status: UNINITIALIZED for 2s [ 895.950588] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: IN_PROGRESS for 2s [ 896.315871] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7: rpc.has_security_group_logging(os_id): False [ 896.339936] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.339936] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.339936] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.339936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.340477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.340477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.340477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.340477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.340477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.340477] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 896.407076] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.407076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.407076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.407076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.407548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.421453] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 897.115975] env[65992]: INFO networking_nsxv3.common.synchronization [req-3ebb77f4-48df-47b7-895e-d58db29f31b0 req-64556076-36b4-42cd-a2d9-1dbdb0abbe57 tempest-MigrationsAdminTest-1940019867 tempest-MigrationsAdminTest-1940019867-project-member] Enqueued Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 897.117473] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 897.118148] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.118286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.118434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.118817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.119132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.119330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.119473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.119885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.120309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.120309] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.624532] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.964621] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 897.964866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.965069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.965472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.965863] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.966011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.966112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.966478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.966590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.966710] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.968798] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 in Status: SUCCESS [ 897.968974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.969126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.969291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.970134] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.970134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.970269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.970350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.970459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.970898] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.125906] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.438848] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 898.439631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.473273] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.475646] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.475646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.475646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.475646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.475646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.475952] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.475952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.476218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.476987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.477120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.477254] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 is going to be deleted. [ 898.513364] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.513555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.514868] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.514868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.515189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.515189] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.633141] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.633510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.633510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.634321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.634321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.634321] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c is going to be updated. [ 898.664957] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.664957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.664957] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.665194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.665194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.675748] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: IN_PROGRESS for 2s [ 898.979058] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.018280] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.018412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.018477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.018694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.018917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.019460] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.019460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.019460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.019460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.019460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.019692] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 already deleted. [ 899.019692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.019882] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.021260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.021467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.021580] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.021684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.021748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.021887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.021961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.022704] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.484036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.484036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.484036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.484036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.484036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.484036] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be updated. [ 899.523551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.523551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.523551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.523551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.524081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.525023] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc87cf9e-db04-4df8-82ef-bda74f4ae783',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.526071] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.527485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.527485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.528372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.528372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.528372] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.528372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.528990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.530270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.530270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.530270] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 already deleted. [ 899.530270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.543296] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: IN_PROGRESS for 2s [ 900.034516] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc87cf9e-db04-4df8-82ef-bda74f4ae783: rpc.has_security_group_logging(os_id): False [ 900.053303] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.053469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.053542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.053753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.053840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.054075] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.054176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.054236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.054381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.054455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.054593] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 is going to be created. [ 900.167624] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cc87cf9e-db04-4df8-82ef-bda74f4ae783], does not exist path=[/infra/domains/default/groups/cc87cf9e-db04-4df8-82ef-bda74f4ae783]."\n}' [ 900.167980] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc87cf9e-db04-4df8-82ef-bda74f4ae783 [ 900.168141] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 900.212190] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.212735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.212878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.213164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.217021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.217021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.217021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.217021] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc87cf9e-db04-4df8-82ef-bda74f4ae783 is going to be created. [ 900.236530] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/cc87cf9e-db04-4df8-82ef-bda74f4ae783], does not exist path=[/infra/domains/default/groups/cc87cf9e-db04-4df8-82ef-bda74f4ae783]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc87cf9e-db04-4df8-82ef-bda74f4ae783 [ 900.236696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc87cf9e-db04-4df8-82ef-bda74f4ae783" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.239632] env[65992]: Traceback (most recent call last): [ 900.239632] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 900.239632] env[65992]: return func(*args, **kwargs) [ 900.239632] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 900.239632] env[65992]: res.raise_for_status() [ 900.239632] env[65992]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 900.239632] env[65992]: raise HTTPError(http_error_msg, response=self) [ 900.239632] env[65992]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc87cf9e-db04-4df8-82ef-bda74f4ae783 [ 900.239632] env[65992]: During handling of the above exception, another exception occurred: [ 900.239632] env[65992]: Traceback (most recent call last): [ 900.239632] env[65992]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 900.239632] env[65992]: listener.cb(fileno) [ 900.239632] env[65992]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 900.239632] env[65992]: result = function(*args, **kwargs) [ 900.239632] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 900.239632] env[65992]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 900.239632] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 900.239632] env[65992]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 900.239632] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 900.239632] env[65992]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 900.239632] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 900.239632] env[65992]: res.raise_for_status() [ 900.239632] env[65992]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 900.239632] env[65992]: raise HTTPError(http_error_msg, response=self) [ 900.239632] env[65992]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/cc87cf9e-db04-4df8-82ef-bda74f4ae783 [ 900.239632] env[65992]: Removing descriptor: 60 [ 900.653380] env[65992]: INFO networking_nsxv3.common.synchronization [None req-9d337a6b-6eb8-4def-ac27-543c0f74ac25 None None] Enqueued Resource ID: 20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6 with Priority: HIGHEST for action port [ 900.653940] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6 with Priority: HIGHEST for action port [ 900.654229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.654365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.654417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.654668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.654772] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.686549] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: SUCCESS [ 900.686764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.163470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6 [ 901.163470] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.163470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.163470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.163470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.163470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.163470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6 already deleted. [ 901.163470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20ab2dcc-c3a2-41cc-bdc7-f963024ddbe6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.552754] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 901.552990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.553315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.553556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.553728] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.553848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.553920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.554091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.554170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.554252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.554349] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.555197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.555356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.555522] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.555622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.555683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.555822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.555898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.555984] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.989919] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f7f9163-ef99-48bb-9551-017c98bad05e req-d257ed0b-c18f-4a9a-a425-07d522bb5e14 tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 901.990578] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 901.990917] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.991154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.991255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.991805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.991805] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.991805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.991805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.992019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.992019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.992103] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.057722] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.057943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.061983] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.433014] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f7f9163-ef99-48bb-9551-017c98bad05e req-4af3455d-9198-42ca-b5f5-42d704f4366e tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 902.433014] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 902.433014] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.433014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.494103] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.494284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.494359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.494615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.518055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.518338] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.518474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.518529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.518710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.518821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.519117] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 902.544970] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.545177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.545249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.545467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.545609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.557116] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 902.564097] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.062593] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-648 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.062593] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-648" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.062593] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-648" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.062593] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-648" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.062593] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.062906] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.062906] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.063179] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.063321] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.063522] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.063637] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.063745] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.064384] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.064384] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.064384] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.064384] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.066044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.066219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.066297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.066455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.066536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.066623] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be updated. [ 903.084056] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.084276] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 903.084414] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.084586] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-648" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.084936] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-0b1366c2-e4b5-467a-a670-35d9fd6a760f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.085137] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-0b1366c2-e4b5-467a-a670-35d9fd6a760f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.085266] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-0b1366c2-e4b5-467a-a670-35d9fd6a760f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.085600] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-0b1366c2-e4b5-467a-a670-35d9fd6a760f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.085751] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b1366c2-e4b5-467a-a670-35d9fd6a760f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.095392] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.095524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.095659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.095794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.095935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.106814] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: IN_PROGRESS for 2s [ 903.112412] env[65992]: INFO networking_nsxv3.common.synchronization [None req-6993e5a5-5518-4076-821a-921b5bc44f93 None None] Enqueued Resource ID: d7aa25cf-0462-46a5-9d44-b90de77f5004 with Priority: HIGHEST for action port [ 903.112922] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7aa25cf-0462-46a5-9d44-b90de77f5004 with Priority: HIGHEST for action port [ 903.113233] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7aa25cf-0462-46a5-9d44-b90de77f5004 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.113351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7aa25cf-0462-46a5-9d44-b90de77f5004" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.113423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7aa25cf-0462-46a5-9d44-b90de77f5004" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.113672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7aa25cf-0462-46a5-9d44-b90de77f5004" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.113754] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7aa25cf-0462-46a5-9d44-b90de77f5004',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.588278] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.588603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.588603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.589550] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.589550] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.589550] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 0b1366c2-e4b5-467a-a670-35d9fd6a760f not found, creating... [ 903.589550] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.589740] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.589869] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.590127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.590267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.590544] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.590700] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.590813] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.591036] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.591213] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.591334] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 0b1366c2-e4b5-467a-a670-35d9fd6a760f is going to be created. [ 903.611975] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.612345] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.612611] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.612910] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.613283] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.614100] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-0b1366c2-e4b5-467a-a670-35d9fd6a760f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.619847] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7aa25cf-0462-46a5-9d44-b90de77f5004 [ 903.620099] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.620233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.620302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.620490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.620573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.620662] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7aa25cf-0462-46a5-9d44-b90de77f5004 already deleted. [ 903.620742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7aa25cf-0462-46a5-9d44-b90de77f5004" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.764124] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c9e0974a-f8d6-4c53-a9b4-5d3740890714 None None] Enqueued Resource ID: 9dea7811-9ce0-4494-b800-1981c6538a2a with Priority: HIGHEST for action port [ 903.764816] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dea7811-9ce0-4494-b800-1981c6538a2a with Priority: HIGHEST for action port [ 903.765361] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dea7811-9ce0-4494-b800-1981c6538a2a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.765361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dea7811-9ce0-4494-b800-1981c6538a2a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.765500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dea7811-9ce0-4494-b800-1981c6538a2a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.765770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dea7811-9ce0-4494-b800-1981c6538a2a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.765892] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dea7811-9ce0-4494-b800-1981c6538a2a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.269140] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dea7811-9ce0-4494-b800-1981c6538a2a [ 904.269140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.269140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.269140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.269140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.269140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.269140] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dea7811-9ce0-4494-b800-1981c6538a2a already deleted. [ 904.269401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dea7811-9ce0-4494-b800-1981c6538a2a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.333540] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f7f9163-ef99-48bb-9551-017c98bad05e req-0f03c99f-b2f5-43e9-b96a-d852be60bddd service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 904.335100] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f7f9163-ef99-48bb-9551-017c98bad05e req-0f03c99f-b2f5-43e9-b96a-d852be60bddd service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 904.335290] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f7f9163-ef99-48bb-9551-017c98bad05e req-0f03c99f-b2f5-43e9-b96a-d852be60bddd service nova] Enqueued Resource ID: 0b1366c2-e4b5-467a-a670-35d9fd6a760f with Priority: HIGHEST for action port [ 904.335875] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 904.336073] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 904.336178] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1366c2-e4b5-467a-a670-35d9fd6a760f with Priority: HIGHEST for action port [ 904.336464] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.336630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.336693] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.336924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.336974] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.337879] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.338023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.341113] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b1366c2-e4b5-467a-a670-35d9fd6a760f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.342612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b1366c2-e4b5-467a-a670-35d9fd6a760f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.342612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b1366c2-e4b5-467a-a670-35d9fd6a760f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.342612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b1366c2-e4b5-467a-a670-35d9fd6a760f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.342612] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b1366c2-e4b5-467a-a670-35d9fd6a760f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.567821] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 904.567821] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 deletion is rescheduled due to dependency. [ 904.568825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.568825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.568825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.568825] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.568825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.568825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.568825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.569352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.569352] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.846111] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.846111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.846111] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b1366c2-e4b5-467a-a670-35d9fd6a760f with status ACTIVE [ 904.846111] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.846111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.846553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.846553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.846553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.846646] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.846698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.847547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.847547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.847547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.847547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.847547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.847547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.847547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.847547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.847837] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b1366c2-e4b5-467a-a670-35d9fd6a760f is going to be updated. [ 904.871850] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.871850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.871850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.871850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.871850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.871850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b1366c2-e4b5-467a-a670-35d9fd6a760f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.002027] env[65992]: INFO networking_nsxv3.common.synchronization [req-539b34d2-3425-48f5-9fd4-f5e258b014c2 req-2bf58c97-7927-4151-9361-45e7f3677715 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 905.002423] env[65992]: INFO networking_nsxv3.common.synchronization [req-539b34d2-3425-48f5-9fd4-f5e258b014c2 req-2bf58c97-7927-4151-9361-45e7f3677715 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 905.004840] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 905.007031] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 905.007031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.007031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.007031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.007031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.007488] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.008151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.008585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.009098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.011037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.011037] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.013084] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.013505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.013746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.014090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.014407] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.015740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.015740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.015740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.015740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.015740] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.056445] env[65992]: INFO networking_nsxv3.common.synchronization [req-539b34d2-3425-48f5-9fd4-f5e258b014c2 req-2bf58c97-7927-4151-9361-45e7f3677715 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_rules [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [req-539b34d2-3425-48f5-9fd4-f5e258b014c2 req-2bf58c97-7927-4151-9361-45e7f3677715 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [req-539b34d2-3425-48f5-9fd4-f5e258b014c2 req-2bf58c97-7927-4151-9361-45e7f3677715 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [req-539b34d2-3425-48f5-9fd4-f5e258b014c2 req-2bf58c97-7927-4151-9361-45e7f3677715 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [req-539b34d2-3425-48f5-9fd4-f5e258b014c2 req-2bf58c97-7927-4151-9361-45e7f3677715 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with Priority: HIGHEST for action port [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_rules [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with Priority: HIGHEST for action port [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 905.060025] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 905.060025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.060025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.060025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.060025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.060025] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.060025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.060025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.060025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.060025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.060723] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.060752] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.060863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.060959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.061202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.061274] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3d748e-7b41-4697-85f0-6c602c7e2ecc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.064971] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.064971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.064971] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.064971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.072744] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.121663] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 905.121663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.121663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.121663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.121663] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.121663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.121663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.121663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.121663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.121663] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.375767] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.375923] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-681" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.376155] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-681" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.376325] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-681" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.376579] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.376788] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.376959] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.377294] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.377430] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.377651] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.377785] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.378273] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.378273] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.378394] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.378468] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.378794] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.403478] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.403478] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.403478] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.403478] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-681" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.403478] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-5981f448-a359-4ce2-bd77-dc03a3ebc563 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.403914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-5981f448-a359-4ce2-bd77-dc03a3ebc563" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.403914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-5981f448-a359-4ce2-bd77-dc03a3ebc563" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.404067] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-5981f448-a359-4ce2-bd77-dc03a3ebc563" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.404180] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5981f448-a359-4ce2-bd77-dc03a3ebc563',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.517178] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.520703] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.563670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.563793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.566613] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.566613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.567817] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with status ACTIVE [ 905.567935] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.568087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.568156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.568383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.568527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.568721] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.568854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.568929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.569107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.569373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.569373] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.569482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.569536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.569681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.569847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.569911] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc is going to be updated. [ 905.574800] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.591622] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.591788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.591851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.592140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.592349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.592447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.624070] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.909020] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.909020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.909020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.909020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.909020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.909020] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 5981f448-a359-4ce2-bd77-dc03a3ebc563 not found, creating... [ 905.909020] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.909020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.909020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.909020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.909020] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.909663] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.909663] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.909663] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.909663] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.910144] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.910394] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 5981f448-a359-4ce2-bd77-dc03a3ebc563 is going to be created. [ 905.932032] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.932032] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.932032] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.932387] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.932387] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.933031] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-5981f448-a359-4ce2-bd77-dc03a3ebc563" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.023025] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.023025] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.078602] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.078602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.078602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.078602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.078602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.078965] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 906.112617] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.112748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.112824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.113041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.113180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.122620] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 906.126679] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.182052] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f94b7e5f-4804-410b-9c56-2aee3e6a1a36 None None] Enqueued Resource ID: 4d5c7d64-e206-4c4a-a949-42a26c64031f with Priority: HIGHEST for action port [ 906.182670] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d5c7d64-e206-4c4a-a949-42a26c64031f with Priority: HIGHEST for action port [ 906.182849] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d5c7d64-e206-4c4a-a949-42a26c64031f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.182985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d5c7d64-e206-4c4a-a949-42a26c64031f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.183063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d5c7d64-e206-4c4a-a949-42a26c64031f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.183325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d5c7d64-e206-4c4a-a949-42a26c64031f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.183406] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d5c7d64-e206-4c4a-a949-42a26c64031f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.524208] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.524353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.524417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.524612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.524700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.524793] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 is going to be created. [ 906.526527] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.526697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.526816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.527022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.529247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.529247] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 906.553637] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.553808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.553902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.555126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.555126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.556544] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.556667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.556734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.556937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.557099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.565758] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 906.566542] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: UNINITIALIZED for 2s [ 906.631771] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.631771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.631771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.631771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.631771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.631771] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be updated. [ 906.652296] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f7f9163-ef99-48bb-9551-017c98bad05e req-8d07f400-cd7f-4bdb-9778-931d0824d2eb service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 906.652296] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f7f9163-ef99-48bb-9551-017c98bad05e req-8d07f400-cd7f-4bdb-9778-931d0824d2eb service nova] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 906.652296] env[65992]: INFO networking_nsxv3.common.synchronization [req-7f7f9163-ef99-48bb-9551-017c98bad05e req-8d07f400-cd7f-4bdb-9778-931d0824d2eb service nova] Enqueued Resource ID: 5981f448-a359-4ce2-bd77-dc03a3ebc563 with Priority: HIGHEST for action port [ 906.653325] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_rules [ 906.654871] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 906.654871] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5981f448-a359-4ce2-bd77-dc03a3ebc563 with Priority: HIGHEST for action port [ 906.655483] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.656244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.656619] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.656901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.657257] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-5981f448-a359-4ce2-bd77-dc03a3ebc563 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.658313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5981f448-a359-4ce2-bd77-dc03a3ebc563" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.658313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5981f448-a359-4ce2-bd77-dc03a3ebc563" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.658313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5981f448-a359-4ce2-bd77-dc03a3ebc563" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.658313] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5981f448-a359-4ce2-bd77-dc03a3ebc563',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.665651] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.665887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.666217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.666503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.666846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.678019] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: IN_PROGRESS for 2s [ 906.685990] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d5c7d64-e206-4c4a-a949-42a26c64031f [ 906.686389] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.687074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.687398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.687476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.687598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.687787] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d5c7d64-e206-4c4a-a949-42a26c64031f already deleted. [ 906.687885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d5c7d64-e206-4c4a-a949-42a26c64031f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.769401] env[65992]: INFO networking_nsxv3.common.synchronization [None req-9cc8b340-a6df-49e8-abd9-65ce4b29ac62 None None] Enqueued Resource ID: e2c77ec4-fef1-49e8-8cae-2518e4a2dc89 with Priority: HIGHEST for action port [ 906.769886] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2c77ec4-fef1-49e8-8cae-2518e4a2dc89 with Priority: HIGHEST for action port [ 906.770209] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2c77ec4-fef1-49e8-8cae-2518e4a2dc89 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.770330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2c77ec4-fef1-49e8-8cae-2518e4a2dc89" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.770440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2c77ec4-fef1-49e8-8cae-2518e4a2dc89" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.770640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2c77ec4-fef1-49e8-8cae-2518e4a2dc89" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.770714] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2c77ec4-fef1-49e8-8cae-2518e4a2dc89',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.003506] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a84ba8e-c4f7-4199-99a9-1d079964f4d5 req-3979ce97-b034-4b34-b0b3-d82100b40cd6 tempest-AttachVolumeShelveTestJSON-1466192988 tempest-AttachVolumeShelveTestJSON-1466192988-project-member] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_members [ 907.004767] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_members [ 907.004767] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.004767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.004767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.004972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.004972] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.005180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.005243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.005406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.006557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.006557] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.163018] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5981f448-a359-4ce2-bd77-dc03a3ebc563 with status ACTIVE [ 907.163018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.163018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.163018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.163018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.163018] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5981f448-a359-4ce2-bd77-dc03a3ebc563 is going to be updated. [ 907.189844] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.191455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.191455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.191455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.191455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.191455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5981f448-a359-4ce2-bd77-dc03a3ebc563" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.274860] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2c77ec4-fef1-49e8-8cae-2518e4a2dc89 [ 907.275187] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.275381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.275481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.276047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.276047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.276047] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2c77ec4-fef1-49e8-8cae-2518e4a2dc89 already deleted. [ 907.276047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2c77ec4-fef1-49e8-8cae-2518e4a2dc89" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.476405] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.476405] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.476405] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.476405] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.476840] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.476840] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.476840] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.477027] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.477108] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.477308] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.477412] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.477514] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.477613] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.477716] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.477825] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.478018] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.498903] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.499119] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.499260] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.499428] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.500139] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-bca10115-1c7e-4f45-9979-e01934fb5db1 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.503504] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.503504] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.503504] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.503504] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca10115-1c7e-4f45-9979-e01934fb5db1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.511407] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.511561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.511635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.511839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.511927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.512294] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.512294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.512294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.512434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.512475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.512557] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a already deleted. [ 907.512634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.005919] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.006292] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.006335] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.006657] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.006913] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.006998] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port bca10115-1c7e-4f45-9979-e01934fb5db1 not found, creating... [ 908.007786] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.007786] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.007786] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.008048] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.008380] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.008525] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.008624] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.008727] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.008963] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.012235] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.012312] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: bca10115-1c7e-4f45-9979-e01934fb5db1 is going to be created. [ 908.034030] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.034217] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.034328] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.034594] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.034808] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.035041] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.135856] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 908.136119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.136295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.136524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.136741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.136866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.136933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.137113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.137194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.137290] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.583019] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 908.583019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.583019] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: SUCCESS [ 908.583019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.583019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.583019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.583309] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.583309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.583309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.584069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.584221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.584328] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.585158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.585337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.585507] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.585615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.585679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.585823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.585901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.586008] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.643244] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.689635] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 908.689851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.690409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.690620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.690800] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.691154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.691154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.691340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.691422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.691506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.691666] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.691759] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.691818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.692124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.692610] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.692610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.692610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.692610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.692846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.692846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.692846] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.758715] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a84ba8e-c4f7-4199-99a9-1d079964f4d5 req-e54e1280-27f6-40a1-8c56-f999c11acb36 service nova] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_rules [ 908.758715] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a84ba8e-c4f7-4199-99a9-1d079964f4d5 req-e54e1280-27f6-40a1-8c56-f999c11acb36 service nova] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_members [ 908.758715] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a84ba8e-c4f7-4199-99a9-1d079964f4d5 req-e54e1280-27f6-40a1-8c56-f999c11acb36 service nova] Enqueued Resource ID: bca10115-1c7e-4f45-9979-e01934fb5db1 with Priority: HIGHEST for action port [ 908.758715] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_rules [ 908.758715] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_members [ 908.758715] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca10115-1c7e-4f45-9979-e01934fb5db1 with Priority: HIGHEST for action port [ 908.758715] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.758715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.758715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.759242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.759242] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.760685] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.760685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.760685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.760685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.760685] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.760685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.760685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.760685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.760685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.762280] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.765045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bca10115-1c7e-4f45-9979-e01934fb5db1 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.765203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.765249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.765404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.765474] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca10115-1c7e-4f45-9979-e01934fb5db1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.088547] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.090864] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.099153] env[65992]: INFO networking_nsxv3.common.synchronization [req-cc5f165a-411a-4809-b7e8-8edefc873678 req-da55454f-f201-4b90-9abe-572e6db55f29 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 909.099153] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 909.099153] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.099153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.099153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.099153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.099153] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.099153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.099153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.099153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.099153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.100103] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.144798] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.194999] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8: rpc.has_security_group_logging(os_id): False [ 909.214503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.214713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.214713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.214909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.225640] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e4abbbd6-fdff-4425-9c63-1a844f29d2c0 None None] Enqueued Resource ID: f5c0df0b-2b45-4312-82dd-4cdef765159f with Priority: HIGHEST for action port [ 909.226430] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5c0df0b-2b45-4312-82dd-4cdef765159f with Priority: HIGHEST for action port [ 909.227038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5c0df0b-2b45-4312-82dd-4cdef765159f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.227232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5c0df0b-2b45-4312-82dd-4cdef765159f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.227232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5c0df0b-2b45-4312-82dd-4cdef765159f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.230044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5c0df0b-2b45-4312-82dd-4cdef765159f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.230044] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c0df0b-2b45-4312-82dd-4cdef765159f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.234591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.237018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.237018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.237018] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.237018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.237524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.237524] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be updated. [ 909.267136] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.268093] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.268201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.268357] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bca10115-1c7e-4f45-9979-e01934fb5db1 with status ACTIVE [ 909.268522] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.268629] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.268692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.268967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.269069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.269238] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.269333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.269390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.269543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.269619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.269815] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.272581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.272581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.272738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.272818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.272908] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bca10115-1c7e-4f45-9979-e01934fb5db1 is going to be updated. [ 909.296405] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.296913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.296913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.297048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.297370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.297567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.304904] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.304904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.304904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.304904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.305168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.321777] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: IN_PROGRESS for 2s [ 909.535348] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.535538] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.535632] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.535902] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.536164] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.536320] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.536439] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.536747] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.536972] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.537192] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.537305] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.537441] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.537605] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.537729] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.537836] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.537970] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.558577] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.558743] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 909.558947] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.559204] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.559457] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-109307d8-d34b-4dd2-a103-8e54973b4a41 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.559628] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-109307d8-d34b-4dd2-a103-8e54973b4a41" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.559744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-109307d8-d34b-4dd2-a103-8e54973b4a41" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.560186] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-109307d8-d34b-4dd2-a103-8e54973b4a41" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.560260] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109307d8-d34b-4dd2-a103-8e54973b4a41',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.591728] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.592570] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.605436] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.648056] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.648268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.648347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.648567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.648660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.648761] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 909.676243] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.676433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.676691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.676847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.676895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.686467] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 909.731317] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5c0df0b-2b45-4312-82dd-4cdef765159f [ 909.731563] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.731696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.731774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.731973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.732559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.732559] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5c0df0b-2b45-4312-82dd-4cdef765159f already deleted. [ 909.732559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5c0df0b-2b45-4312-82dd-4cdef765159f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.774806] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.063702] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.063939] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.064073] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.064360] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.064508] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.064655] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 109307d8-d34b-4dd2-a103-8e54973b4a41 not found, creating... [ 910.064905] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.065074] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.065185] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.067039] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.067249] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.067581] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.067827] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.067999] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.068296] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.068469] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.068701] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 109307d8-d34b-4dd2-a103-8e54973b4a41 is going to be created. [ 910.091908] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.091908] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.091908] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.092415] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.092415] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.092597] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-109307d8-d34b-4dd2-a103-8e54973b4a41" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.095269] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.095403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.095468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.096014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.096014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.096014] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 910.097171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.097274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.097351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.097486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.097565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.097651] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 is going to be updated. [ 910.107984] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.128200] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.129631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.129631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.129759] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.129903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.132218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.132378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.132428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.132656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.132739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.143470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: IN_PROGRESS for 2s [ 910.144155] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 910.280393] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.280393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.280393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.280393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.280393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.280393] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a is going to be created. [ 910.317845] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.318118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.318243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.318463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.318656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.333381] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: UNINITIALIZED for 2s [ 910.612812] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.612980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.613052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.613259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.613346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.613442] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 910.632737] env[65992]: INFO networking_nsxv3.common.synchronization [None req-7c22dbdf-f0bf-486f-9bd3-a64bfc430ce2 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_rules [ 910.632980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_rules [ 910.633245] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.633245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.633429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.633596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.633748] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.644078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.644242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.644303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.644617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.644617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.654656] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 910.803047] env[65992]: INFO networking_nsxv3.common.synchronization [req-cc5f165a-411a-4809-b7e8-8edefc873678 req-82ec69dc-0044-4164-b3aa-e5377199c341 service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 910.803180] env[65992]: INFO networking_nsxv3.common.synchronization [req-cc5f165a-411a-4809-b7e8-8edefc873678 req-82ec69dc-0044-4164-b3aa-e5377199c341 service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 910.803289] env[65992]: INFO networking_nsxv3.common.synchronization [req-cc5f165a-411a-4809-b7e8-8edefc873678 req-82ec69dc-0044-4164-b3aa-e5377199c341 service nova] Enqueued Resource ID: 109307d8-d34b-4dd2-a103-8e54973b4a41 with Priority: HIGHEST for action port [ 910.803746] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 910.803871] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 910.804117] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 109307d8-d34b-4dd2-a103-8e54973b4a41 with Priority: HIGHEST for action port [ 910.804539] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.804661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.804742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.805012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.805108] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.806127] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.806415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.806517] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-109307d8-d34b-4dd2-a103-8e54973b4a41 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.806635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-109307d8-d34b-4dd2-a103-8e54973b4a41" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.806695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-109307d8-d34b-4dd2-a103-8e54973b4a41" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.807953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-109307d8-d34b-4dd2-a103-8e54973b4a41" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.807953] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109307d8-d34b-4dd2-a103-8e54973b4a41',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.886376] env[65992]: INFO networking_nsxv3.common.synchronization [None req-bfda9385-7e24-4ed7-a595-0f59ab50c2fb tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_rules [ 910.887452] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_rules [ 910.887955] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.888085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.154916] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.155892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.155892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.155892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.155892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.155892] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff already deleted. [ 911.155892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.155892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.155892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.156136] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.309491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.310663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.312177] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 109307d8-d34b-4dd2-a103-8e54973b4a41 with status ACTIVE [ 911.312607] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.312607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.312709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.313663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.313724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.314463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.314463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.314463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.314463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.314463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.317771] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.318853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.318853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.318853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.318853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.318853] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 109307d8-d34b-4dd2-a103-8e54973b4a41 is going to be updated. [ 911.322739] env[65992]: INFO networking_nsxv3.common.synchronization [req-5cf959a2-4c76-46bd-b13b-0debe4fd4ea9 req-1440d543-25ff-4783-bbb2-0888471c7990 tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_members [ 911.324767] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_members [ 911.325150] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.325288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.325343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.325622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.325793] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.326225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.326225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.326937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.326937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.327155] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.376429] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 911.376429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.376429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.376429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.376429] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.381698] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.381974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.382054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.382357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.383034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.383034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-109307d8-d34b-4dd2-a103-8e54973b4a41" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.678236] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.678429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.678471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.678717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.678897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.679118] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff already deleted. [ 911.679218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.698150] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 911.698447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.698635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.700845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.700845] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.700845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.700845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.700845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.700845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.700845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.700845] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.700845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.701266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.701266] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.701407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.701501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.701815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.701815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.701942] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.830430] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.830816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.831047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.831392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.832086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.832086] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.832086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.832086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.832340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.832430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.832542] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e35d0a29-9466-4e93-850f-29921a743936 already deleted. [ 911.832674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.879514] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.879702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.879750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.880059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.880233] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.880351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.880435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.880587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.880666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.880750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.880831] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.883259] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.883471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.883615] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.883811] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.884084] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.884246] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.884487] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.884733] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.884883] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.885126] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.885242] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.885333] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.885561] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.885561] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.885679] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.885800] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.905773] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.905931] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.905979] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.906141] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.906474] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-33815683-e88a-4f0f-9b21-a47d698d9ead taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.906648] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-33815683-e88a-4f0f-9b21-a47d698d9ead" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.906765] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-33815683-e88a-4f0f-9b21-a47d698d9ead" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.907151] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-33815683-e88a-4f0f-9b21-a47d698d9ead" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.907366] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33815683-e88a-4f0f-9b21-a47d698d9ead',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.166032] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: SUCCESS [ 912.166032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.166032] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 912.166032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.166496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.166496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.166496] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.166621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.166669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.166931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.166931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.167081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.167126] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.167975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.168634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.168634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.168634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.168634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.169640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.169640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.169640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.169640] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.205229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.205359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.205534] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.345359] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: SUCCESS [ 912.345604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.346381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.346699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.346917] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.347089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.347162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.347400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.347501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.347597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.347750] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.388317] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.388529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.388601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.388833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.389014] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.389569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.389635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.389797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.389883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.389972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.390149] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.390244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.390303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.390442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.390580] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.390674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.390733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.390867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.390942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.391030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.391134] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.410216] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.410434] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.410557] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.410816] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.410959] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.411176] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 33815683-e88a-4f0f-9b21-a47d698d9ead not found, creating... [ 912.411410] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.411572] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.411690] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.411910] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.412058] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.412337] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.412490] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.412604] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.412807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.412938] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.413086] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 33815683-e88a-4f0f-9b21-a47d698d9ead is going to be created. [ 912.435886] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.436145] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.436296] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.436683] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.436988] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.437170] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-33815683-e88a-4f0f-9b21-a47d698d9ead" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.665125] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 912.665397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.665987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.666300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.666500] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.666625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.666678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.666848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.666956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.667247] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.670675] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.671545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.671669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.671735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.672049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.672186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.672461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.672461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.672621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.672828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.672880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.673529] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.673529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.673529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.673529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.673721] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.673721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.673721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.673873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.673948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.674036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.674141] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.708116] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.850979] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.893364] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8: rpc.has_security_group_logging(os_id): False [ 912.912553] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.912758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.912831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.913061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.913152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.913359] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.913458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.913520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.913667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.913742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.913953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.914051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.914088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.914226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.914296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.914492] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.914586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.914645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.914780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.914851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.914935] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be updated. [ 912.981109] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.981254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.981322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.981544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.981683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.995254] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: IN_PROGRESS for 2s [ 913.151966] env[65992]: INFO networking_nsxv3.common.synchronization [req-5cf959a2-4c76-46bd-b13b-0debe4fd4ea9 req-fe87ad92-94a0-45b3-9ab3-5e5bec4e4412 service nova] Enqueued Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_rules [ 913.152160] env[65992]: INFO networking_nsxv3.common.synchronization [req-5cf959a2-4c76-46bd-b13b-0debe4fd4ea9 req-fe87ad92-94a0-45b3-9ab3-5e5bec4e4412 service nova] Enqueued Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_members [ 913.152300] env[65992]: INFO networking_nsxv3.common.synchronization [req-5cf959a2-4c76-46bd-b13b-0debe4fd4ea9 req-fe87ad92-94a0-45b3-9ab3-5e5bec4e4412 service nova] Enqueued Resource ID: 33815683-e88a-4f0f-9b21-a47d698d9ead with Priority: HIGHEST for action port [ 913.152806] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_rules [ 913.152969] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_members [ 913.153348] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33815683-e88a-4f0f-9b21-a47d698d9ead with Priority: HIGHEST for action port [ 913.153631] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.153755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.153847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.154241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.154334] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.157166] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.157166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.157166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.157166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.157166] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.157166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.157166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.157166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.157166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.157166] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.157491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-33815683-e88a-4f0f-9b21-a47d698d9ead taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.157491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33815683-e88a-4f0f-9b21-a47d698d9ead" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.157579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33815683-e88a-4f0f-9b21-a47d698d9ead" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.157680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33815683-e88a-4f0f-9b21-a47d698d9ead" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.157750] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33815683-e88a-4f0f-9b21-a47d698d9ead',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.169306] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.176734] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4017384d-1105-4cfb-b204-60d05dcc6f67: rpc.has_security_group_logging(os_id): False [ 913.178306] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7: rpc.has_security_group_logging(os_id): False [ 913.206662] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.206662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.206662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.206662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.206662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.206662] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.206662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.206662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.206662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.207128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.207128] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 is going to be created. [ 913.209695] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.209695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.209904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.209939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.212208] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.212329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.212368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.212520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.212603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.212696] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 913.254140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.254525] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.254525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.254626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.254778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.255119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.255341] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.255496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.255496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.259020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.259020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.259020] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.259020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.259020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.259020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.259020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.259020] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 913.279262] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.279466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.279531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.279739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.279940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.286847] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.287060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.287130] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.287370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.287568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.300046] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 913.305022] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: IN_PROGRESS for 2s [ 913.342818] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.342818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.342818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.342818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.342818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.355322] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85011876-1ce8-49d5-9b25-2c9588597a4a: rpc.has_security_group_logging(os_id): False [ 913.375893] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.376049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.376124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.376329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.376429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.376654] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.376867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.376945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.377109] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.377278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.377278] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a is going to be created. [ 913.378775] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 913.511325] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.511551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.511551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.511882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.512059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.531741] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: IN_PROGRESS for 2s [ 913.660374] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.661143] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.661266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.661921] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33815683-e88a-4f0f-9b21-a47d698d9ead with status ACTIVE [ 913.661921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.661921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.661921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.661921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.662190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.662190] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.662260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.662289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.662447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.662525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.662725] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.662803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.662861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.662998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.663569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.663569] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33815683-e88a-4f0f-9b21-a47d698d9ead is going to be updated. [ 913.672507] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.694360] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.694727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.694883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.695125] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.695289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.695491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33815683-e88a-4f0f-9b21-a47d698d9ead" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.947715] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.947715] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.947715] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.947715] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.948306] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.948678] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.949730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.950387] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.951139] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.951312] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.951619] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.952763] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.952763] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.952763] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.952763] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.952763] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.974452] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.974944] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.974944] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.975130] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-603" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.975416] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-e2cec206-c93b-4743-b0f8-e06217e357e8 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.975613] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.975741] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.976109] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.976316] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2cec206-c93b-4743-b0f8-e06217e357e8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.166129] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.175772] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.176140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.176140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.176238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.176331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.176430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 914.215508] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.215508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.215712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.216022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.216221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.235940] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 914.350828] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f3be2f9e-eed1-4a54-b3be-9ef7e539931f None None] Enqueued Resource ID: 019f52cd-8890-406f-bd03-4799fdc77a3c with Priority: HIGHEST for action port [ 914.352414] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019f52cd-8890-406f-bd03-4799fdc77a3c with Priority: HIGHEST for action port [ 914.353098] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-019f52cd-8890-406f-bd03-4799fdc77a3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.353255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-019f52cd-8890-406f-bd03-4799fdc77a3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.353324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-019f52cd-8890-406f-bd03-4799fdc77a3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.355150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-019f52cd-8890-406f-bd03-4799fdc77a3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.355285] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('019f52cd-8890-406f-bd03-4799fdc77a3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.479398] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.479696] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.479867] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.480251] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.480450] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.480874] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.481076] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.481244] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.481518] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.481670] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.482803] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.483083] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.483246] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.483548] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.483721] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.483892] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: e2cec206-c93b-4743-b0f8-e06217e357e8 is going to be updated. [ 914.516971] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.517390] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.517594] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.517874] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.518189] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.518563] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.669130] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.669314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.669407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.669687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.669815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.669943] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e35d0a29-9466-4e93-850f-29921a743936 is going to be created. [ 914.701748] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.701950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.701950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.702202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.702354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.714814] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e35d0a29-9466-4e93-850f-29921a743936 in Status: UNINITIALIZED for 2s [ 914.859364] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 019f52cd-8890-406f-bd03-4799fdc77a3c [ 914.859364] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.859364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.859364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.859364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.859364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.859364] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:019f52cd-8890-406f-bd03-4799fdc77a3c already deleted. [ 914.859364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-019f52cd-8890-406f-bd03-4799fdc77a3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.008396] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 915.008504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.219497] env[65992]: INFO networking_nsxv3.common.synchronization [req-ab425da1-68a4-47d2-8ca4-1507d53be30e req-c975c0b4-4963-4ca2-b4bf-2e9a7b7c5bf1 service nova] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_rules [ 915.219497] env[65992]: INFO networking_nsxv3.common.synchronization [req-ab425da1-68a4-47d2-8ca4-1507d53be30e req-c975c0b4-4963-4ca2-b4bf-2e9a7b7c5bf1 service nova] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 915.219497] env[65992]: INFO networking_nsxv3.common.synchronization [req-ab425da1-68a4-47d2-8ca4-1507d53be30e req-c975c0b4-4963-4ca2-b4bf-2e9a7b7c5bf1 service nova] Enqueued Resource ID: e2cec206-c93b-4743-b0f8-e06217e357e8 with Priority: HIGHEST for action port [ 915.219902] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_rules [ 915.219902] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 915.220083] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cec206-c93b-4743-b0f8-e06217e357e8 with Priority: HIGHEST for action port [ 915.220514] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.220736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.221024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.221127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.221233] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.222222] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.222438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.222517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.222772] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.222989] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.224343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.224459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.224664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.224795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.224929] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.226094] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2cec206-c93b-4743-b0f8-e06217e357e8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.226094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.226094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.226604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.226604] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2cec206-c93b-4743-b0f8-e06217e357e8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.327078] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 915.327078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.327078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.327078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.327078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.327078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.327078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.327078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.327078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.327078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.331226] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.331226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.331226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.331226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.331226] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.331226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.331226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.331546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.331546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.331546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.331546] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.333258] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: SUCCESS [ 915.333453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.391975] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 915.392632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.547679] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: SUCCESS [ 915.547907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.728503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.728646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.728854] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.729828] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2cec206-c93b-4743-b0f8-e06217e357e8 with status ACTIVE [ 915.730154] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.730154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.730274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.730603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.730752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.731165] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.731295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.731442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.731640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.731726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.731922] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.732079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.732124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.732236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.732312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.732400] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2cec206-c93b-4743-b0f8-e06217e357e8 is going to be updated. [ 915.764314] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.764727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.764727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.764727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.764874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.765051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2cec206-c93b-4743-b0f8-e06217e357e8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.835121] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94744e32-5aaa-4c96-a135-74003f101fb3: rpc.has_security_group_logging(os_id): False [ 915.876052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.876222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.876273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.876519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.876651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.876943] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.876943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.876943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.877301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.877301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.877436] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.877436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.877552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.877666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.877746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.877936] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.878049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.878110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.878251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.878323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.878421] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 915.996116] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.996116] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.996288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.996582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.996799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.026170] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 916.234739] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.251722] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 916.252064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.252289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.252494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.252700] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.252881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.252974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.253180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.253262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.253348] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.253441] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.384261] env[65992]: INFO networking_nsxv3.common.synchronization [req-0bc6729b-e829-4aa2-a094-882f5843e408 req-df880c68-3aa0-42cd-beba-6a4cf7dfffb2 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 916.384931] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 916.385304] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.386316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.386552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.387444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.387641] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.387751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.387813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.387995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.388098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.388191] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.727771] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e35d0a29-9466-4e93-850f-29921a743936 in Status: SUCCESS [ 916.728029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.728221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.728459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.728659] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.728782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.728915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.729099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.729183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.729273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.729366] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.738721] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.738944] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.738981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.739205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.739291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.739420] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be updated. [ 916.763025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.763025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.763025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.763025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.763025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.763861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.763861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.763861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.763861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.763861] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.772936] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.772936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.772936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.772936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.773135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.792603] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: IN_PROGRESS for 2s [ 916.894536] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.895997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.895997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.896452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.924272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.924272] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.925486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.925579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.929025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.929025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.929025] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 916.968390] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.969152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.969349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.969349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.969349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.983563] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 917.234772] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.267152] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6417014f-241b-4b36-8b7b-aeef9e200013: rpc.has_security_group_logging(os_id): False [ 917.292155] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.292155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.292155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.292155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.342096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.342096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.342096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.342096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.342748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.342748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.342928] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 917.411360] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.412133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.412133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.412133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.412133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.424922] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 917.590599] env[65992]: INFO networking_nsxv3.common.synchronization [None req-bd4d4033-4801-40a5-bf88-a718a4b64103 None None] Enqueued Resource ID: d00e471b-6589-464f-80b7-359819ae5db9 with Priority: HIGHEST for action port [ 917.591140] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d00e471b-6589-464f-80b7-359819ae5db9 with Priority: HIGHEST for action port [ 917.592074] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-d00e471b-6589-464f-80b7-359819ae5db9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.592257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d00e471b-6589-464f-80b7-359819ae5db9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.593035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d00e471b-6589-464f-80b7-359819ae5db9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.593035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d00e471b-6589-464f-80b7-359819ae5db9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.593035] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d00e471b-6589-464f-80b7-359819ae5db9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.737674] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e35d0a29-9466-4e93-850f-29921a743936: rpc.has_security_group_logging(os_id): False [ 917.756704] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.756964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.757053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.757579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.757579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.757579] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.757746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.757746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.757874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.757947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.758081] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e35d0a29-9466-4e93-850f-29921a743936 is going to be created. [ 917.842228] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.842431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.842859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.842859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.843014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.857843] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e35d0a29-9466-4e93-850f-29921a743936 in Status: IN_PROGRESS for 2s [ 918.044177] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 918.044177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.044177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.044177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.044177] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.096498] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d00e471b-6589-464f-80b7-359819ae5db9 [ 918.096498] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.096750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.096750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.096843] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.096936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.097054] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d00e471b-6589-464f-80b7-359819ae5db9 already deleted. [ 918.097138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d00e471b-6589-464f-80b7-359819ae5db9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.552025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.552025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.552025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.552025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.552025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.552025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.552025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.552025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.552025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.552025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.552025] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.802951] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 918.803216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.803386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.803651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.803853] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.803978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.804058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.804222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.804334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.804421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.804509] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.996944] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 918.997211] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 918.997354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.059783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.059972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.060060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.060286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.064030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.064030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.064030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.064030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.064030] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.307270] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.307523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.307677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.307973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.308290] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.308401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.308493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.308722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.308891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.309034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.309168] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.309320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.309430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.309635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.312752] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.312960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.312960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.313175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.313865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.313865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.313865] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.441580] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 919.441580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.564934] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94744e32-5aaa-4c96-a135-74003f101fb3: rpc.has_security_group_logging(os_id): False [ 919.587570] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.587753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.587803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.587998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.588105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.588323] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.588444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.588523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.588623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.588865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.588931] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.589018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.589100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.589275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.589344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.589577] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.589722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.589786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.589953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.590241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.590364] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 919.641091] env[65992]: INFO networking_nsxv3.common.synchronization [req-2ffe20ce-f286-4c13-a9c0-80d2284f58ae req-20c7f336-4c3c-4c9f-b111-54eb813112ce tempest-ServerRescueTestJSON-228920212 tempest-ServerRescueTestJSON-228920212-project-member] Enqueued Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 919.641815] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 919.642589] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.642814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.642814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.643058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.643296] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.643408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.643462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.643674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.643798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.644313] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.663709] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.663949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.664091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.664383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.664553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.682027] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 919.820039] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6: rpc.has_security_group_logging(os_id): False [ 919.846215] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.846415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.846533] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.846753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.870293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.870581] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.870721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.870787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.870999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.871149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.871349] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.871461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.871461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.871627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.871699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.871921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.872488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.872636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.872814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.872899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.872999] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be updated. [ 919.874771] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e35d0a29-9466-4e93-850f-29921a743936 in Status: SUCCESS [ 919.875655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.955042] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.955480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.955480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.955686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.955958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.981210] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: IN_PROGRESS for 2s [ 920.149419] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.149617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.149702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.150052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.150173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.150604] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.150604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.150604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.150830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.150860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.150939] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 already deleted. [ 920.151048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.166191] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.166491] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-27" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.167184] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-27" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.167184] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-27" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.167527] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.167743] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.167881] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.168144] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.168333] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.168583] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.168728] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.168906] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.169065] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.169199] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.169331] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.169499] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.191458] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.191608] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.191751] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.191921] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-27" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.192260] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-ed7465d9-372c-454c-ac0f-d366e284d36b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.192485] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-ed7465d9-372c-454c-ac0f-d366e284d36b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.192572] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-ed7465d9-372c-454c-ac0f-d366e284d36b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.192918] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-ed7465d9-372c-454c-ac0f-d366e284d36b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.193067] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7465d9-372c-454c-ac0f-d366e284d36b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.400957] env[65992]: INFO networking_nsxv3.common.synchronization [req-5b71bb08-5bfd-4311-afd8-d8d03ac2c442 req-a61d99ec-3275-4bc8-8503-15479e04a614 tempest-ServerRescueTestJSONUnderV235-343603750 tempest-ServerRescueTestJSONUnderV235-343603750-project-member] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 920.401556] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGHEST for action security_group_members [ 920.401784] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.401912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.401993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.402220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.402396] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.402504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.402570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.402743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.402829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.402932] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.696041] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.696373] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.696519] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.696893] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.697086] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.697305] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port ed7465d9-372c-454c-ac0f-d366e284d36b not found, creating... [ 920.697664] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.697886] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.698059] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.698357] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.698542] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.698995] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.699167] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.699293] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.699561] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.699754] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.699959] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: ed7465d9-372c-454c-ac0f-d366e284d36b is going to be created. [ 920.726984] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.727965] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.727965] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.727965] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.727965] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.728256] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-ed7465d9-372c-454c-ac0f-d366e284d36b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.905255] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.905473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.905558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.905779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.905898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.906132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.906273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.906327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.906581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.906752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.906844] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be updated. [ 920.988911] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.989165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.989221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.989452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.989655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.000530] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: IN_PROGRESS for 2s [ 921.224028] env[65992]: INFO networking_nsxv3.common.synchronization [req-ab47c6e9-c5d6-4e29-af20-79b745d297ae req-054f8101-a972-407b-af10-53a4c4bc9848 tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 921.224028] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 921.224028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.224028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.224028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.224028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.224028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.224028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.224028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.224028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.224028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.224028] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.490665] env[65992]: INFO networking_nsxv3.common.synchronization [req-2ffe20ce-f286-4c13-a9c0-80d2284f58ae req-d09094cf-efc5-49f7-a26b-0ae552a829d1 service nova] Enqueued Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_rules [ 921.490885] env[65992]: INFO networking_nsxv3.common.synchronization [req-2ffe20ce-f286-4c13-a9c0-80d2284f58ae req-d09094cf-efc5-49f7-a26b-0ae552a829d1 service nova] Enqueued Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 921.491045] env[65992]: INFO networking_nsxv3.common.synchronization [req-2ffe20ce-f286-4c13-a9c0-80d2284f58ae req-d09094cf-efc5-49f7-a26b-0ae552a829d1 service nova] Enqueued Resource ID: ed7465d9-372c-454c-ac0f-d366e284d36b with Priority: HIGHEST for action port [ 921.491621] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_rules [ 921.491782] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 921.491915] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7465d9-372c-454c-ac0f-d366e284d36b with Priority: HIGHEST for action port [ 921.492275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.492409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.492480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.492719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.492817] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.494153] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.494276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.494343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.494544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.494740] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.494862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.494929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.495102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.495186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.495302] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.497187] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed7465d9-372c-454c-ac0f-d366e284d36b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.497187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed7465d9-372c-454c-ac0f-d366e284d36b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.497187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed7465d9-372c-454c-ac0f-d366e284d36b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.497187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed7465d9-372c-454c-ac0f-d366e284d36b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.497187] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7465d9-372c-454c-ac0f-d366e284d36b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.581064] env[65992]: INFO networking_nsxv3.common.synchronization [req-ab47c6e9-c5d6-4e29-af20-79b745d297ae req-e17b2980-4b6c-4a13-87f2-22413f39d55b tempest-ServersTestMultiNic-681779130 tempest-ServersTestMultiNic-681779130-project-member] Enqueued Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 921.581636] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94744e32-5aaa-4c96-a135-74003f101fb3 with Priority: HIGHEST for action security_group_members [ 921.582334] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-94744e32-5aaa-4c96-a135-74003f101fb3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.582334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.700521] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 921.700521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.727420] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.904095] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca19cc23-37c9-4db6-ad41-1355c261de46 req-c4097415-f737-4c7b-b3d7-84620bc46f6f tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 921.904185] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 921.904521] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.904629] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.904689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.904894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.905060] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.905160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.905223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.905376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.905456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.905545] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.994982] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 921.995368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.999136] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.999319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.999472] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.000567] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed7465d9-372c-454c-ac0f-d366e284d36b with status ACTIVE [ 922.000567] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.000746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.000746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.000931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.001019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.001242] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.001350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.001414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.001603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.001682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.001895] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.004698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.004811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.005252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.005252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.005252] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed7465d9-372c-454c-ac0f-d366e284d36b is going to be updated. [ 922.037965] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.037965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.037965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.037965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.037965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.037965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed7465d9-372c-454c-ac0f-d366e284d36b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.230378] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.281593] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 922.281593] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 922.281593] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc with Priority: HIGHEST for action security_group_members [ 922.281593] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 922.281593] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 922.281593] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc with Priority: HIGHEST for action security_group_members [ 922.282207] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.282207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.282207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.282321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.283086] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.283086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.283361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.283361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.283483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.283531] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.284755] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.285058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.285058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.285677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.285677] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.285677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.285677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.285885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.285885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.285885] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.286913] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.287077] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.287155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.288390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.288390] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.288390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.288390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.288390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.288390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.288390] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.343699] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.343920] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.344067] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.344349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.344605] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.344759] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.344891] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.345143] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.345315] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.345529] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.345641] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.345753] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.345864] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.345970] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.346095] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.346224] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.359708] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_rules [ 922.360224] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 922.360425] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 922.360542] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 922.360745] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc with Priority: HIGHEST for action security_group_rules [ 922.360745] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc with Priority: HIGHEST for action security_group_members [ 922.360878] env[65992]: INFO networking_nsxv3.common.synchronization [req-d6c3dbdb-e207-4106-a33e-f97c5ef621a9 req-425aee95-a6e5-420b-bc1c-471c374f4cc6 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with Priority: HIGHEST for action port [ 922.364257] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_rules [ 922.364452] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_rules [ 922.364927] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc with Priority: HIGHEST for action security_group_members [ 922.364927] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with Priority: HIGHEST for action port [ 922.364927] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc with Priority: HIGHEST for action security_group_rules [ 922.364927] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 922.364927] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 922.365410] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.365540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.365610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.365803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.365920] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.367511] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.367718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.367830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.367990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.375162] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.375162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.375162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.375162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.375162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.375162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.375162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.375162] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f3d748e-7b41-4697-85f0-6c602c7e2ecc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.375162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceb0e57d-ce29-4b09-b94f-4026125ca9bc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.376032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.376032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.376032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.376032] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.376790] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.376985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.377203] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.377350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.382789] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.383379] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.383591] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.383787] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.387355] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-72592729-f878-412e-812d-ad70e05bead9 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.387639] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-72592729-f878-412e-812d-ad70e05bead9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.387852] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-72592729-f878-412e-812d-ad70e05bead9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.388775] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-72592729-f878-412e-812d-ad70e05bead9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.388775] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72592729-f878-412e-812d-ad70e05bead9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.408391] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.646462] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.732482] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.732981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.732981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.733157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.733258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.733364] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 922.775292] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.775536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.775652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.775912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.776097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.789110] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 922.791052] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.791438] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.792375] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.878388] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.878536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.892317] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f3d748e-7b41-4697-85f0-6c602c7e2ecc with status ACTIVE [ 922.893207] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.893369] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.893489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.893752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.893892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.894088] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.894216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.894264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.894467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.894557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.894851] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.894933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.895299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.895465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.895543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.895787] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f3d748e-7b41-4697-85f0-6c602c7e2ecc is going to be updated. [ 922.897237] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.898199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.898513] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.898608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.899181] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.899374] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.899491] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.899756] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.899919] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.900114] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 72592729-f878-412e-812d-ad70e05bead9 not found, creating... [ 922.900371] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.900549] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.900663] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.900876] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.901035] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.901349] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.901516] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.901635] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.901860] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.902028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.902175] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 72592729-f878-412e-812d-ad70e05bead9 is going to be created. [ 922.919070] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.935202] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.935545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.935683] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.935957] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.936203] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.936436] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-72592729-f878-412e-812d-ad70e05bead9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.938424] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.938605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.938605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.939225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.939225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.939225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f3d748e-7b41-4697-85f0-6c602c7e2ecc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.018264] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 in Status: SUCCESS [ 923.018264] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 deletion is rescheduled due to dependency. [ 923.018264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.149895] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.149895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.149895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.150266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.150266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.150360] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 is going to be created. [ 923.177649] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.177884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.177963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.178222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.178378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.197041] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: UNINITIALIZED for 2s [ 923.293455] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.296538] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.299762] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.423482] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.423704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.424619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.424619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.424619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.424619] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 923.458812] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.459124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.459206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.459472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.459625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.470661] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 923.649309] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca19cc23-37c9-4db6-ad41-1355c261de46 req-75d19864-45da-4947-b04d-c40a508da5e5 service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 923.649639] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca19cc23-37c9-4db6-ad41-1355c261de46 req-75d19864-45da-4947-b04d-c40a508da5e5 service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 923.649769] env[65992]: INFO networking_nsxv3.common.synchronization [req-ca19cc23-37c9-4db6-ad41-1355c261de46 req-75d19864-45da-4947-b04d-c40a508da5e5 service nova] Enqueued Resource ID: 72592729-f878-412e-812d-ad70e05bead9 with Priority: HIGHEST for action port [ 923.650326] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 923.650653] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 923.650653] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72592729-f878-412e-812d-ad70e05bead9 with Priority: HIGHEST for action port [ 923.650844] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.650962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.651232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.651645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.651838] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.658175] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.658175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.658175] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-72592729-f878-412e-812d-ad70e05bead9 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.658175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72592729-f878-412e-812d-ad70e05bead9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.658175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72592729-f878-412e-812d-ad70e05bead9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.658175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72592729-f878-412e-812d-ad70e05bead9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.658175] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72592729-f878-412e-812d-ad70e05bead9',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.799344] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.799705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.799705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.801065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.801065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.801065] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 923.802918] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.802918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.802918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.802918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.802918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.802918] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 is going to be updated. [ 923.804524] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.804524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.804669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.805280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.805280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.805280] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc is going to be created. [ 923.835131] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.835370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.835455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.835691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.835841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.839943] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.840176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.840226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.840455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.840858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.842751] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.843895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.843895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.843895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.843895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.851031] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc in Status: UNINITIALIZED for 2s [ 923.854308] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: IN_PROGRESS for 2s [ 923.855197] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 924.157496] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.157694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.160092] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72592729-f878-412e-812d-ad70e05bead9 with status ACTIVE [ 924.160323] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.160485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.160555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.160770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.160865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.161059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.161715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.161715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.161715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.161715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.161910] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.161910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.162024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.162144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.162220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.162415] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72592729-f878-412e-812d-ad70e05bead9 is going to be updated. [ 924.187630] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.187779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.187844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.188167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.188398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.188606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72592729-f878-412e-812d-ad70e05bead9" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.571057] env[65992]: INFO networking_nsxv3.common.synchronization [None req-478be05f-e5b8-4846-b1f4-16a9502dc68c tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_rules [ 924.571625] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_rules [ 924.571987] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.572181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.572181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.572848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.572848] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.810549] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 924.810845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.811086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.811411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.811720] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.812204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.812204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.812407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.812521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.813435] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94744e32-5aaa-4c96-a135-74003f101fb3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.824295] env[65992]: INFO networking_nsxv3.common.synchronization [None req-b4e3681e-3e4e-4249-831c-8ca6541b83db tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_rules [ 924.824295] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_rules [ 924.825274] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.825532] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.100487] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.100631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.100725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.101012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.101121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.101249] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 already deleted. [ 925.101415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.102514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.102717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.102807] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.207480] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: SUCCESS [ 925.207851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.207954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.208157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.208357] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.208493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.208558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.208707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.208787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.209022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.209127] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.323051] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.323051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.323051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.323051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.323051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.323051] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.323051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.323051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.323051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.323051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.323051] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 is going to be updated. [ 925.366258] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.366626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.366626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.366850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.366995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.379401] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: IN_PROGRESS for 2s [ 925.484107] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 925.484342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.484506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.484757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.485180] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.485180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.485180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.485378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.485378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.485481] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.521184] env[65992]: INFO networking_nsxv3.common.synchronization [req-cfc01ec5-e056-4426-a014-e30f7742a5fe req-288be1ff-370e-4993-943e-688fde2f4740 tempest-MultipleCreateTestJSON-1501668855 tempest-MultipleCreateTestJSON-1501668855-project-member] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 925.521759] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 925.522211] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.522211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.522341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.522526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.522680] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.522776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.522828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.523227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.523372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.523467] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.628598] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.630140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.630140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.630140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.630140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.630140] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 already deleted. [ 925.630140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.711899] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.712074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.712145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.712335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.712595] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.712595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.712756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.712795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.712847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.713561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.713795] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.713910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.713981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.714124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.715140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.715140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.715140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.715140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.715140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.715140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.715140] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.863431] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc in Status: SUCCESS [ 925.863826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.864273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.864475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.864886] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.865251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.865251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.865432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.865522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.865648] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.867540] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 925.867727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.869865] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: SUCCESS [ 925.869865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.869865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.869865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.869865] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.869865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.869865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.869865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.869865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.869865] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.870950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.871599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.871599] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.871599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.871599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.871599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.871790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.871790] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.931234] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.931493] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.931635] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.931997] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.932824] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.933130] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.933352] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.933718] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.933949] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.934125] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.934240] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.934354] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.934453] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.934616] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.934916] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.935092] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.956470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.957405] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 925.957405] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.957405] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.957664] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-8e112b1e-f227-4d25-8b8e-f179a0666954 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.957883] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-8e112b1e-f227-4d25-8b8e-f179a0666954" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.958047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-8e112b1e-f227-4d25-8b8e-f179a0666954" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.958439] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-8e112b1e-f227-4d25-8b8e-f179a0666954" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.958590] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e112b1e-f227-4d25-8b8e-f179a0666954',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.962316] env[65992]: INFO networking_nsxv3.common.synchronization [req-f8c7dc3c-4ce5-4bab-8310-04c1c7e36b65 req-7ab90b4f-f8c6-47bf-be4b-537c35f9aa61 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 925.963152] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 925.963492] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.963621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.963687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.963893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.964090] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.964197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.964257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.964462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.964547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.964864] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.992821] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.026525] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.026901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.026901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.027394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.027394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.027394] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.027567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.027567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.027687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.027922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.027922] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 already deleted. [ 926.027922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.217266] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc75e044-2bf1-4d6d-8a88-0619925a4394: rpc.has_security_group_logging(os_id): False [ 926.240231] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.240231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.240231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.240497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.240497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.240567] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.240650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.240720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.241025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.241166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.244234] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.244234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.244234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.244234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.244234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.244234] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.244234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.244234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.244234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.244234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.244234] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 is going to be created. [ 926.324932] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.325190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.325190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.325440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.325720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.340522] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: IN_PROGRESS for 2s [ 926.374553] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.375315] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.376080] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.464653] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.464653] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.464653] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.464989] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.464989] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.465108] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 8e112b1e-f227-4d25-8b8e-f179a0666954 not found, creating... [ 926.465308] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.465462] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.465575] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.465784] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.465918] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.466406] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.466406] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.466610] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.466661] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.466791] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.466940] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 8e112b1e-f227-4d25-8b8e-f179a0666954 is going to be created. [ 926.468437] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.491457] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.491825] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.491825] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.492135] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.492376] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.492661] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-8e112b1e-f227-4d25-8b8e-f179a0666954" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.495213] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.545263] env[65992]: INFO networking_nsxv3.common.synchronization [req-f1df7e17-eb1d-4b15-82b1-e74b95e2962f req-2891db0b-226f-4395-b38d-847687f19c5d tempest-MigrationsAdminTest-1940019867 tempest-MigrationsAdminTest-1940019867-project-member] Enqueued Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 926.545869] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c with Priority: HIGHEST for action security_group_members [ 926.546240] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.546364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.546425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.546632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.546786] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.546938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.547095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.547456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.547568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.547653] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a7c14c-af0d-4c42-abda-f1b7e2eebf3c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.831415] env[65992]: INFO networking_nsxv3.common.synchronization [req-763a78fc-b3e3-4075-a221-1d568b7a4e14 req-ed16b2a9-d304-49e4-843d-9e97540abe83 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 926.831606] env[65992]: INFO networking_nsxv3.common.synchronization [req-763a78fc-b3e3-4075-a221-1d568b7a4e14 req-ed16b2a9-d304-49e4-843d-9e97540abe83 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 926.831704] env[65992]: INFO networking_nsxv3.common.synchronization [req-763a78fc-b3e3-4075-a221-1d568b7a4e14 req-ed16b2a9-d304-49e4-843d-9e97540abe83 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc with Priority: HIGHEST for action security_group_members [ 926.832456] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGHEST for action security_group_members [ 926.832595] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 926.832697] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc with Priority: HIGHEST for action security_group_members [ 926.832978] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.833111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.833387] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.833474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.834089] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.834089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.877811] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.879150] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.879633] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.971098] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.997850] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.998133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.998202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.998451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.998546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.998650] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 927.033655] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.033655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.033655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.033655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.033655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.042156] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 927.050366] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.053092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.053092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.053092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.077063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.077063] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.077063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.077063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.077063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.077063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.077063] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c is going to be updated. [ 927.131095] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.131095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.131095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.131095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.131095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.141192] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: IN_PROGRESS for 2s [ 927.234776] env[65992]: INFO networking_nsxv3.common.synchronization [req-cfc01ec5-e056-4426-a014-e30f7742a5fe req-cf84b4f8-f9fe-4e7c-ad0e-a4d191a02220 service nova] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_rules [ 927.235019] env[65992]: INFO networking_nsxv3.common.synchronization [req-cfc01ec5-e056-4426-a014-e30f7742a5fe req-cf84b4f8-f9fe-4e7c-ad0e-a4d191a02220 service nova] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 927.235264] env[65992]: INFO networking_nsxv3.common.synchronization [req-cfc01ec5-e056-4426-a014-e30f7742a5fe req-cf84b4f8-f9fe-4e7c-ad0e-a4d191a02220 service nova] Enqueued Resource ID: 8e112b1e-f227-4d25-8b8e-f179a0666954 with Priority: HIGHEST for action port [ 927.236329] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_rules [ 927.236771] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 927.236771] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e112b1e-f227-4d25-8b8e-f179a0666954 with Priority: HIGHEST for action port [ 927.240260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.240260] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.240260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.240260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.240260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.240856] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.241450] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e112b1e-f227-4d25-8b8e-f179a0666954 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.241607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e112b1e-f227-4d25-8b8e-f179a0666954" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.241684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e112b1e-f227-4d25-8b8e-f179a0666954" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.241847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e112b1e-f227-4d25-8b8e-f179a0666954" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.241920] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e112b1e-f227-4d25-8b8e-f179a0666954',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.382042] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.383099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.383099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.383099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.383099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.383099] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 927.384901] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.385096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.385192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.385423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.385550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.385735] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc is going to be updated. [ 927.387096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.387231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.387297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.387677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.387677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.387890] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 is going to be updated. [ 927.402912] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94744e32-5aaa-4c96-a135-74003f101fb3 in Status: SUCCESS [ 927.403134] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94744e32-5aaa-4c96-a135-74003f101fb3 deletion is rescheduled due to dependency. [ 927.403248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94744e32-5aaa-4c96-a135-74003f101fb3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.432251] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.432251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.432251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.432455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.432574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.434691] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.434845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.434845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.435060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.435722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.437154] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.437263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.437309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.437624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.437700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.452404] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: IN_PROGRESS for 2s [ 927.453271] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 927.454312] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc in Status: IN_PROGRESS for 2s [ 927.473615] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.473746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.475011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.475011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.475011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.475011] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 927.508554] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.508554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.508554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.508735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.508796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.519514] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 927.725719] env[65992]: INFO networking_nsxv3.common.synchronization [req-cfc01ec5-e056-4426-a014-e30f7742a5fe req-6c5bb308-a07f-457a-bdbf-74210ccbf387 tempest-MultipleCreateTestJSON-1501668855 tempest-MultipleCreateTestJSON-1501668855-project-member] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 927.726375] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 927.726806] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.726914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.743992] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.744147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.744341] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.745302] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e112b1e-f227-4d25-8b8e-f179a0666954 with status ACTIVE [ 927.745493] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.745608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.745671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.745882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.745971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.746231] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.746375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.746444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.746599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.746692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.746916] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.749196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.749314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.749495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.749593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.749720] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e112b1e-f227-4d25-8b8e-f179a0666954 is going to be updated. [ 927.783352] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.783352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.783465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.783711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.783855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.784027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e112b1e-f227-4d25-8b8e-f179a0666954" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.137123] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.137123] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.137123] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.137123] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.137592] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.137592] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.137691] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.137833] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.138103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.138337] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 928.138446] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.138547] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.138648] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.138750] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 928.138847] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.139080] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.160443] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.160652] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 928.160789] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.161180] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.161729] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.161880] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.162027] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.162346] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.162710] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.252746] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.361278] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: SUCCESS [ 928.362148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.665553] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.665799] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.665883] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.666244] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.666377] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.666508] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f not found, creating... [ 928.666782] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.667019] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.667207] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.667461] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.667599] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.667910] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.668169] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.668239] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.668454] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.668542] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.668680] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f is going to be created. [ 928.691592] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.691849] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.691959] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.693181] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.693181] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.693181] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.756040] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.756040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.756040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.756425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.756425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.756481] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be created. [ 928.787118] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.787332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.787429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.787709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.787946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.816998] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: UNINITIALIZED for 2s [ 929.052878] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 929.053121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.053278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.053519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.053712] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.053831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.053889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.054056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.054136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.054259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.054406] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.152310] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c in Status: SUCCESS [ 929.152741] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a7c14c-af0d-4c42-abda-f1b7e2eebf3c deletion is rescheduled due to dependency. [ 929.152741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a7c14c-af0d-4c42-abda-f1b7e2eebf3c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.413558] env[65992]: INFO networking_nsxv3.common.synchronization [req-cfc01ec5-e056-4426-a014-e30f7742a5fe req-b5580735-ce54-4594-aae0-20ff7b476315 service nova] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_rules [ 929.413741] env[65992]: INFO networking_nsxv3.common.synchronization [req-cfc01ec5-e056-4426-a014-e30f7742a5fe req-b5580735-ce54-4594-aae0-20ff7b476315 service nova] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 929.413870] env[65992]: INFO networking_nsxv3.common.synchronization [req-cfc01ec5-e056-4426-a014-e30f7742a5fe req-b5580735-ce54-4594-aae0-20ff7b476315 service nova] Enqueued Resource ID: dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f with Priority: HIGHEST for action port [ 929.414398] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_rules [ 929.414535] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 929.414627] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f with Priority: HIGHEST for action port [ 929.414895] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.414997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.415197] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.415349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.415537] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.415613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.415662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.415855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.415931] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.464330] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 929.464685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.464989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.465238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.465463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.465587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.465649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.465811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.465891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.465974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.466100] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.467493] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc in Status: SUCCESS [ 929.467662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.468325] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: SUCCESS [ 929.468486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.468622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.468787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.469123] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.469123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.469222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.469282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.469354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.469437] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.470215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.470382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.470534] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.470635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.470696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.470827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.470900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.470978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.471111] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.471699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.471839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.471985] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.472127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.472192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.472331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.472404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.472485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.472570] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.473539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.473695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.473835] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.473931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.473999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.474168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.474238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.474318] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.475172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.475172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.475338] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.475338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.475447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.475483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.475584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.476156] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.529371] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 929.529655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.558047] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.558047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.558047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.558297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.558456] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.558562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.558626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.558802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.558911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.559011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.559172] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.559268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.559315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.559455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.559587] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.559713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.559713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.559882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.559926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.560087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.560087] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.919125] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f with status ACTIVE [ 929.919523] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.919523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.919523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.919727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.920035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.920266] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.920380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.920445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.920643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.920715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.921127] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.922298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.922298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.922298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.922298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.922298] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f is going to be updated. [ 929.945027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.945214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.945259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.945625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.945804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.945994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd7d24f0-0bfd-4fb4-8bf9-3d68fa716a2f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.974670] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ceb0e57d-ce29-4b09-b94f-4026125ca9bc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.975968] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.977045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.977168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.978031] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.978465] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.978586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.978651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.978914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.979023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.979202] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.979287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.979373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.979655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.980099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.980099] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 is going to be updated. [ 929.981741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.982290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.982290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.982290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.982290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.982572] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.983609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.983609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.983609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.983609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.983609] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc is going to be deleted. [ 930.032540] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.032829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.032829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.033091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.033264] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.033378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.034459] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.034639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.035171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.035561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.035706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.047893] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: IN_PROGRESS for 2s [ 930.062134] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 246ce419-a7b7-4e23-8bd8-c4c071ac447a: rpc.has_security_group_logging(os_id): False [ 930.083533] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.083737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.083838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.084122] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.109895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.110462] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.110639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.110747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.111055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.111170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.111420] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.111549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.112489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.112489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.112489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.112489] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.112489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.112489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.112774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.112774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.112859] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 930.191368] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.191790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.191790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.193039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.193039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.206331] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 930.307908] env[65992]: INFO networking_nsxv3.common.synchronization [req-5f3e2d92-4f51-49c1-beee-fe1583cce9ca req-bb99481e-d39a-442d-9232-21d2a87dfc81 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_members [ 930.308622] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_members [ 930.309119] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.309278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.309331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.309650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.309830] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.309956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.310197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.310252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.310429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.310477] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.478716] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ceb0e57d-ce29-4b09-b94f-4026125ca9bc: rpc.has_security_group_logging(os_id): False [ 930.479970] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.486638] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4017384d-1105-4cfb-b204-60d05dcc6f67: rpc.has_security_group_logging(os_id): False [ 930.500753] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.500944] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.501061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.501383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.501489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.501808] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.501976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.502111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.502349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.502424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.502533] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc is going to be created. [ 930.507252] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.507400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.507469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.507784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.507902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.508185] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.508295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.508361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.508524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.508601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.508699] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 is going to be updated. [ 930.521624] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ceb0e57d-ce29-4b09-b94f-4026125ca9bc], does not exist path=[/infra/domains/default/groups/ceb0e57d-ce29-4b09-b94f-4026125ca9bc]."\n}' [ 930.521778] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ceb0e57d-ce29-4b09-b94f-4026125ca9bc [ 930.521865] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 930.568260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.568260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.568260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.568260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.568260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.570354] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.570511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.570572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.571072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.572021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.572277] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.572423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.572423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.572609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.572784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.572920] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.572994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.573075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.573214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.573308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.573358] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceb0e57d-ce29-4b09-b94f-4026125ca9bc is going to be created. [ 930.589181] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: IN_PROGRESS for 2s [ 930.591584] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ceb0e57d-ce29-4b09-b94f-4026125ca9bc], does not exist path=[/infra/domains/default/groups/ceb0e57d-ce29-4b09-b94f-4026125ca9bc]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ceb0e57d-ce29-4b09-b94f-4026125ca9bc [ 930.591731] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceb0e57d-ce29-4b09-b94f-4026125ca9bc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.596329] env[65992]: Traceback (most recent call last): [ 930.596329] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 930.596329] env[65992]: return func(*args, **kwargs) [ 930.596329] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 930.596329] env[65992]: res.raise_for_status() [ 930.596329] env[65992]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 930.596329] env[65992]: raise HTTPError(http_error_msg, response=self) [ 930.596329] env[65992]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ceb0e57d-ce29-4b09-b94f-4026125ca9bc [ 930.596329] env[65992]: During handling of the above exception, another exception occurred: [ 930.596329] env[65992]: Traceback (most recent call last): [ 930.596329] env[65992]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 930.596329] env[65992]: listener.cb(fileno) [ 930.596329] env[65992]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 930.596329] env[65992]: result = function(*args, **kwargs) [ 930.596329] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 930.596329] env[65992]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 930.596329] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 930.596329] env[65992]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 930.596329] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 930.596329] env[65992]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 930.596329] env[65992]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 930.596329] env[65992]: res.raise_for_status() [ 930.596329] env[65992]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 930.596329] env[65992]: raise HTTPError(http_error_msg, response=self) [ 930.596329] env[65992]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ceb0e57d-ce29-4b09-b94f-4026125ca9bc [ 930.596329] env[65992]: Removing descriptor: 60 [ 930.695502] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.695709] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.695877] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.696295] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.696579] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.696744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.696859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.697127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.697278] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.697486] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.697612] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.697715] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.697818] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.697924] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.698036] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.698169] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.729681] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.729834] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.730050] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.730227] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.730550] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-557be63b-43fc-427d-96bb-63f05c5f888b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.730727] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-557be63b-43fc-427d-96bb-63f05c5f888b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.730890] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-557be63b-43fc-427d-96bb-63f05c5f888b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.731449] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-557be63b-43fc-427d-96bb-63f05c5f888b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.731748] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('557be63b-43fc-427d-96bb-63f05c5f888b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.813084] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.813084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.813084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.813519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.813519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.813605] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.813717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.813776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.814011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.814076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.814166] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff already deleted. [ 930.814228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.829508] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 930.829756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.829991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.830267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.830532] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.830665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.830766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.830981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.831127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.831297] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.984736] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.984897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.984969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.985241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.985331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.985431] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 931.018434] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.018589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.018671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.019039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.019260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.031816] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 931.234944] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.235597] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.235597] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.236048] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.236315] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.236619] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 557be63b-43fc-427d-96bb-63f05c5f888b not found, creating... [ 931.237104] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.237415] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.237641] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.238069] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.238325] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.238872] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.239201] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.239430] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.239822] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.240149] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.240343] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 557be63b-43fc-427d-96bb-63f05c5f888b is going to be created. [ 931.280912] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.281203] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.281349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.281639] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.281927] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.282176] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-557be63b-43fc-427d-96bb-63f05c5f888b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.335210] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.837640] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.013860] env[65992]: INFO networking_nsxv3.common.synchronization [req-5f3e2d92-4f51-49c1-beee-fe1583cce9ca req-05b87484-54e1-43ab-ab0c-94d91e712b76 service nova] Enqueued Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_rules [ 932.014081] env[65992]: INFO networking_nsxv3.common.synchronization [req-5f3e2d92-4f51-49c1-beee-fe1583cce9ca req-05b87484-54e1-43ab-ab0c-94d91e712b76 service nova] Enqueued Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_members [ 932.014290] env[65992]: INFO networking_nsxv3.common.synchronization [req-5f3e2d92-4f51-49c1-beee-fe1583cce9ca req-05b87484-54e1-43ab-ab0c-94d91e712b76 service nova] Enqueued Resource ID: 557be63b-43fc-427d-96bb-63f05c5f888b with Priority: HIGHEST for action port [ 932.017348] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_rules [ 932.017348] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_members [ 932.017348] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 557be63b-43fc-427d-96bb-63f05c5f888b with Priority: HIGHEST for action port [ 932.017348] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.017348] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.017348] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.017348] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.017348] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.018583] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.018760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.018862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.020776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.021137] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.021322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.025017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.025017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.025017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.025017] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.025017] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-557be63b-43fc-427d-96bb-63f05c5f888b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.025017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-557be63b-43fc-427d-96bb-63f05c5f888b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.025017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-557be63b-43fc-427d-96bb-63f05c5f888b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.025017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-557be63b-43fc-427d-96bb-63f05c5f888b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.025017] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('557be63b-43fc-427d-96bb-63f05c5f888b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.060443] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: SUCCESS [ 932.060443] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 deletion is rescheduled due to dependency. [ 932.060443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.229591] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 932.229857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.341014] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.341408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.341408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.341661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.341866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.342473] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 932.381292] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.381292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.381717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.381717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.381828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.396025] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 932.529022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.529293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.529460] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.530478] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 557be63b-43fc-427d-96bb-63f05c5f888b with status ACTIVE [ 932.530781] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.531009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.531009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.531337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.531459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.532158] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.532315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.532411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.532672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.532765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.533045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.533140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.533189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.533388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.533473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.533546] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 557be63b-43fc-427d-96bb-63f05c5f888b is going to be updated. [ 932.568236] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.568617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.568617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.569029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.569203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.569363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-557be63b-43fc-427d-96bb-63f05c5f888b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.613170] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 in Status: SUCCESS [ 932.613504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.005064] env[65992]: INFO networking_nsxv3.common.synchronization [req-d2a92462-7227-4c1c-8e43-028b5dd2782d req-64bda82e-fc81-4db4-beed-1ce270af39ec tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 933.007026] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 933.007026] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.007026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.007026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.007026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.007026] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.007026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.007026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.007026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.007026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.007026] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.035598] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.044098] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 933.044231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.044305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.044531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.044743] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.044892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.044971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.045195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.045499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.045499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.045596] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.045643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.045747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.045845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.046044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.046426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.046426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.046426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.046587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.046587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.047205] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.415825] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.416267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.416267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.416405] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.416673] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.416926] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.417070] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.417297] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.417438] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.417642] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.417750] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.417853] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.417957] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.418074] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 933.418179] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.418306] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.443884] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.444289] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 933.444567] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.444887] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.445444] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-647ab7cf-9235-43bf-8a27-96c7814c4676 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.445966] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-647ab7cf-9235-43bf-8a27-96c7814c4676" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.446093] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-647ab7cf-9235-43bf-8a27-96c7814c4676" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.446554] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-647ab7cf-9235-43bf-8a27-96c7814c4676" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.446780] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('647ab7cf-9235-43bf-8a27-96c7814c4676',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.511782] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.512037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.512154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.512428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.539856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.539856] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.539856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.539856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.539856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.539856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.539856] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 933.543031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.543031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.543031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.543031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.543031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.543031] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff is going to be created. [ 933.550049] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7: rpc.has_security_group_logging(os_id): False [ 933.576006] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.576286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.576286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.576481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.578588] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.578715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.578751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.578986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.579819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.581395] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.581546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.581600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.581755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.581882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.593910] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 933.595361] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff in Status: UNINITIALIZED for 2s [ 933.605623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.605987] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.606158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.606223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.606408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.606521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.606684] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.606770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.606835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.607028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.607140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.607318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.607421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.607421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.607572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.607666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.607724] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 933.685306] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.685467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.685569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.685928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.686092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.702428] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 933.950694] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.951131] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.951266] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.952043] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.952043] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.952188] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 647ab7cf-9235-43bf-8a27-96c7814c4676 not found, creating... [ 933.952499] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.952732] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.953043] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.953344] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.953501] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.953994] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.954214] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.954471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.954649] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.954859] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.955081] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 647ab7cf-9235-43bf-8a27-96c7814c4676 is going to be created. [ 933.981358] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.981578] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.981691] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.982073] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.982357] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.982591] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-647ab7cf-9235-43bf-8a27-96c7814c4676" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.405789] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 934.406101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.406319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.406590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.406812] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.406941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.407052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.407387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.407387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.407478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.407580] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.408652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.408861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.409129] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.409247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.409332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.409554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.409649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.409744] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.745227] env[65992]: INFO networking_nsxv3.common.synchronization [req-d2a92462-7227-4c1c-8e43-028b5dd2782d req-827d179f-1b2f-4bb6-83c4-8a9705243338 service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 934.745587] env[65992]: INFO networking_nsxv3.common.synchronization [req-d2a92462-7227-4c1c-8e43-028b5dd2782d req-827d179f-1b2f-4bb6-83c4-8a9705243338 service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 934.745587] env[65992]: INFO networking_nsxv3.common.synchronization [req-d2a92462-7227-4c1c-8e43-028b5dd2782d req-827d179f-1b2f-4bb6-83c4-8a9705243338 service nova] Enqueued Resource ID: 647ab7cf-9235-43bf-8a27-96c7814c4676 with Priority: HIGHEST for action port [ 934.747211] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 934.747496] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 934.747744] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 647ab7cf-9235-43bf-8a27-96c7814c4676 with Priority: HIGHEST for action port [ 934.748060] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.748255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.748386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.748718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.748718] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.750440] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.750586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.750792] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-647ab7cf-9235-43bf-8a27-96c7814c4676 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.750889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-647ab7cf-9235-43bf-8a27-96c7814c4676" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.751103] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-647ab7cf-9235-43bf-8a27-96c7814c4676" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.751364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-647ab7cf-9235-43bf-8a27-96c7814c4676" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.751466] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('647ab7cf-9235-43bf-8a27-96c7814c4676',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.912176] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.912358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.912536] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.253699] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.253699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.253859] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 647ab7cf-9235-43bf-8a27-96c7814c4676 with status ACTIVE [ 935.254020] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.254144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.254210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.254729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.254729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.254995] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.255101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.255101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.255281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.255383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.255599] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.255694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.255776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.255931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.256014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.256176] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 647ab7cf-9235-43bf-8a27-96c7814c4676 is going to be updated. [ 935.280030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.280030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.280406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.280698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.281417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.281417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-647ab7cf-9235-43bf-8a27-96c7814c4676" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.415765] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.607354] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 935.607532] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 935.607638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.607813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.608038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.608505] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.608505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.608505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.608775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.608775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.608775] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.610566] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff in Status: SUCCESS [ 935.612187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.612187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.612187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.612187] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.612187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.612187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.612187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.612187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.612187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.612187] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.717884] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 935.718141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.920301] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.920301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.920301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.920301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.920301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.920301] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 935.952810] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.952891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.952986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.953221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.953324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.963659] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 936.113840] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.115182] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.617259] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.619333] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7f9886e-09d8-4717-8a0d-1c46fb28d7ff: rpc.has_security_group_logging(os_id): False [ 936.638192] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.638335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.638417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.638901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.639070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.639473] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.639473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.639473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.639670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.639712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.639791] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff is going to be created. [ 936.703928] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.704102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.704190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.704404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.704522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.726600] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff in Status: IN_PROGRESS for 2s [ 937.121646] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.121979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.121979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.122193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.122193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.122682] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 937.155872] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.155872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.155872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.156124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.156242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.166129] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 937.620300] env[65992]: INFO networking_nsxv3.common.synchronization [req-25bd53c3-3a26-4fc2-ba59-868cefcda548 req-0b916ae9-a2dc-4db9-847a-7f2f0c32c1e0 tempest-ImagesOneServerNegativeTestJSON-1206007642 tempest-ImagesOneServerNegativeTestJSON-1206007642-project-member] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 937.620916] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 937.621246] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.621375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.621440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.621695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.621853] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.621954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.622024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.622177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.622274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.622393] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.967421] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-843 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.967573] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.967662] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.968070] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.968684] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.968883] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.969126] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.969435] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.969648] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.969882] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.970107] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.970609] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.970794] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.970952] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.971108] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.971279] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.983304] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 937.983522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.983693] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.983983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.984145] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.984268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.984330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.984485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.984565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.984647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.984807] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.984920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.984985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.985140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.985280] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.985372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.985430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.985561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.985633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.985710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.985797] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.992321] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.992321] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.992501] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.992620] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.993044] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-3b22905f-a787-4766-a4e7-3c55697c953c taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.993186] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-3b22905f-a787-4766-a4e7-3c55697c953c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.993229] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-3b22905f-a787-4766-a4e7-3c55697c953c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.993528] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-3b22905f-a787-4766-a4e7-3c55697c953c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.993664] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b22905f-a787-4766-a4e7-3c55697c953c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.125121] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.125421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.125421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.125583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.125698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.125887] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.125980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.126037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.126205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.126279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.126435] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 already deleted. [ 938.126435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.488268] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fae6f001-d48c-45ec-8f59-9ecf82d77e91: rpc.has_security_group_logging(os_id): False [ 938.496052] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.496260] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.496372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.496618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.496763] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.496978] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 3b22905f-a787-4766-a4e7-3c55697c953c not found, creating... [ 938.497536] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.497741] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.497845] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.498089] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.498234] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.498575] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.498735] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.498853] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.499171] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.499341] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.499493] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 3b22905f-a787-4766-a4e7-3c55697c953c is going to be created. [ 938.508994] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.509180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.509241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.510039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.510039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.510039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.510039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.510039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.510336] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.510336] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.510431] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.510528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.510588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.510730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.510798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.511136] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.511136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.511136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.511516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.511516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.511516] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be created. [ 938.523370] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.523370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.523558] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.523717] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.524668] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.524668] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-3b22905f-a787-4766-a4e7-3c55697c953c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.747160] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.747417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.747417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.747725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.747875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.754379] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff in Status: SUCCESS [ 938.754652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.764985] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 939.179629] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 939.179992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.180175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.180407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.180605] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.180717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.180775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.180968] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.181321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.181321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.181321] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.266592] env[65992]: INFO networking_nsxv3.common.synchronization [req-25bd53c3-3a26-4fc2-ba59-868cefcda548 req-e321b6ee-9401-4869-bd54-5c9fbc641a8f service nova] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_rules [ 939.267550] env[65992]: INFO networking_nsxv3.common.synchronization [req-25bd53c3-3a26-4fc2-ba59-868cefcda548 req-e321b6ee-9401-4869-bd54-5c9fbc641a8f service nova] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 939.267550] env[65992]: INFO networking_nsxv3.common.synchronization [req-25bd53c3-3a26-4fc2-ba59-868cefcda548 req-e321b6ee-9401-4869-bd54-5c9fbc641a8f service nova] Enqueued Resource ID: 3b22905f-a787-4766-a4e7-3c55697c953c with Priority: HIGHEST for action port [ 939.268436] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_rules [ 939.268651] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 939.268802] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b22905f-a787-4766-a4e7-3c55697c953c with Priority: HIGHEST for action port [ 939.269230] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.269405] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.269476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.269735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.269818] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.270885] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.271020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.271117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.271400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.271605] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.271729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.271810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.271975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.272073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.272156] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.273132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b22905f-a787-4766-a4e7-3c55697c953c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.273258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b22905f-a787-4766-a4e7-3c55697c953c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.273316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b22905f-a787-4766-a4e7-3c55697c953c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.273455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b22905f-a787-4766-a4e7-3c55697c953c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.273528] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b22905f-a787-4766-a4e7-3c55697c953c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.684965] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.685159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.685159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.685538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.685819] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.685942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.686021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.686191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.686280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.686366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.686531] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.686691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.686691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.686923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.687054] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.687254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.687320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.687507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.687639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.687773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.687907] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.775712] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.775712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.775712] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.777042] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b22905f-a787-4766-a4e7-3c55697c953c with status ACTIVE [ 939.777164] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.777228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.777309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.777545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.778179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.778179] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.778179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.778179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.778179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.778179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.778413] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.779064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.779064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.779064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.779064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.779064] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b22905f-a787-4766-a4e7-3c55697c953c is going to be updated. [ 939.803202] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.803362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.803504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.803680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.803908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.804160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b22905f-a787-4766-a4e7-3c55697c953c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.180222] env[65992]: INFO networking_nsxv3.common.synchronization [req-48943473-b41f-4c1e-8fda-038028b1f455 req-e4758e3e-74b5-4a85-8d16-a8b3cead4d1f tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 940.180222] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 940.180222] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.180222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.180222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.180222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.180222] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.180222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.180222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.181047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.181241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.181756] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.191458] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a7f9db-1203-43be-8fe2-0b76907a767d: rpc.has_security_group_logging(os_id): False [ 940.217486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.217486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.217486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.218041] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.218041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.218041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.218041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.218041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.218041] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 940.281132] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.283842] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.284032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.284092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.284270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.284544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.307530] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 940.583380] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.583634] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.583829] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.584348] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.584661] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.584911] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.585108] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.585420] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.585736] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.586140] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.586323] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.586506] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.586678] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.586932] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.587168] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.587389] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.609193] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.609193] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.609193] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.609193] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.609193] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-becd13da-ed3f-4500-9434-42fe22240b94 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.609193] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-becd13da-ed3f-4500-9434-42fe22240b94" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.609193] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-becd13da-ed3f-4500-9434-42fe22240b94" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.609193] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-becd13da-ed3f-4500-9434-42fe22240b94" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.609503] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('becd13da-ed3f-4500-9434-42fe22240b94',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.684024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.684206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.684295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.684557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.707715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.708106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.708308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.708411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.708688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.708810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.708955] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 940.740178] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.740502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.740502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.740602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.740744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.752036] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 940.781760] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 940.781999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.782208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.782420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.782506] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.783659] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.783785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.783850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.784052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.784230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.784329] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be created. [ 940.820331] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.820331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.820331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.820331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.820331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.845525] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: UNINITIALIZED for 2s [ 941.113032] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.113596] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.113794] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.114111] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.114260] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.114410] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port becd13da-ed3f-4500-9434-42fe22240b94 not found, creating... [ 941.114690] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.114849] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.115064] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.115972] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.115972] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.115972] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.115972] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.116196] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.116196] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.116364] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.116500] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: becd13da-ed3f-4500-9434-42fe22240b94 is going to be created. [ 941.148851] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.148851] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.148851] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.149204] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.150047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.150047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-becd13da-ed3f-4500-9434-42fe22240b94" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.286241] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.286701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.286701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.286701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.286876] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.287034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.287126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.287252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.287337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.287431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.287528] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.790106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.790106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.790106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.790355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.790991] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.790991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.790991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.790991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.791205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.791205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.791339] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.791514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.791514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.794026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.794026] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.794026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.794026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.794026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.794026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.794026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.794026] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.951788] env[65992]: INFO networking_nsxv3.common.synchronization [req-48943473-b41f-4c1e-8fda-038028b1f455 req-01ba5a2d-b746-4c8c-b230-64e0f2b8c6ef service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 941.951788] env[65992]: INFO networking_nsxv3.common.synchronization [req-48943473-b41f-4c1e-8fda-038028b1f455 req-01ba5a2d-b746-4c8c-b230-64e0f2b8c6ef service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 941.951961] env[65992]: INFO networking_nsxv3.common.synchronization [req-48943473-b41f-4c1e-8fda-038028b1f455 req-01ba5a2d-b746-4c8c-b230-64e0f2b8c6ef service nova] Enqueued Resource ID: becd13da-ed3f-4500-9434-42fe22240b94 with Priority: HIGHEST for action port [ 941.954052] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 941.954642] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 941.954794] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: becd13da-ed3f-4500-9434-42fe22240b94 with Priority: HIGHEST for action port [ 941.955368] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.955902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.956018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.956321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.956438] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.958093] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.958267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.958625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-becd13da-ed3f-4500-9434-42fe22240b94 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.958764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-becd13da-ed3f-4500-9434-42fe22240b94" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.958764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-becd13da-ed3f-4500-9434-42fe22240b94" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.959027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-becd13da-ed3f-4500-9434-42fe22240b94" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.959215] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('becd13da-ed3f-4500-9434-42fe22240b94',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.295126] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fae6f001-d48c-45ec-8f59-9ecf82d77e91: rpc.has_security_group_logging(os_id): False [ 942.320929] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.321219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.321598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.321672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.321836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.323566] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.323566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.323566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.323566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.323566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.323566] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.323566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.323887] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.324061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.324221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.324601] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.324881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.325027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.325319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.325481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.325803] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 942.329664] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 942.329664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.405616] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.405828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.405929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.406175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.406328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.424677] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 942.461081] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.461366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.465742] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port becd13da-ed3f-4500-9434-42fe22240b94 with status ACTIVE [ 942.468310] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.468310] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.468310] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.468310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.468310] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: becd13da-ed3f-4500-9434-42fe22240b94 is going to be updated. [ 942.498921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.500172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.500172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.500340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.500541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.500759] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-becd13da-ed3f-4500-9434-42fe22240b94" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.764477] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 942.764653] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 942.764763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.764926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.765157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.765346] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.765458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.765517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.765663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.765738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.765825] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.859653] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 942.859653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.859653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.859653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.859653] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.859653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.859653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.859653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.859653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.859653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.859653] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.269434] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.364596] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.364596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.364596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.365077] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.365109] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.371695] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.371695] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.371695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.371695] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.573448] env[65992]: INFO networking_nsxv3.common.synchronization [req-61a3bee4-5e33-400c-a9b6-8d5e121d85c1 req-96550e32-fe24-4b93-a32a-08224b25e149 tempest-MultipleCreateTestJSON-1501668855 tempest-MultipleCreateTestJSON-1501668855-project-member] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 943.576144] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 943.576144] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.576144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.576144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.576144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.576144] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.576144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.576144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.576144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.576144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.576144] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.777500] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.871043] env[65992]: INFO networking_nsxv3.common.synchronization [req-13fefe93-46b4-43ae-9e7a-a4fb0895f4ac req-92385538-fb82-47a2-aedb-b8428a5b0ded tempest-MultipleCreateTestJSON-1501668855 tempest-MultipleCreateTestJSON-1501668855-project-member] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 943.871043] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 943.871449] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.871685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.878039] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e720f82-4c36-4848-b271-696bfa23a791: rpc.has_security_group_logging(os_id): False [ 943.899191] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.899191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.899191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.899191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.899191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.899191] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.899191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.899191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.899191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.899191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.899809] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.899809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.899809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.899924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.900593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.900593] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.900593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.900593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.901010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.901010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.901081] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be created. [ 943.956911] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.956911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.957117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.957206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.957386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.969421] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 944.078063] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.281443] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.281695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.281695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.281840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.281931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.282034] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 944.366092] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.366092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.366092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.366092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.366092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.378468] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 944.447990] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 944.448332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.580976] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.083819] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.083819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.083819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.084072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.084072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.084138] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 945.119490] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.120909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.123123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.123367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.123515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.137569] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 945.703645] env[65992]: INFO networking_nsxv3.common.synchronization [req-8c3df812-4227-438d-9130-e7f54dd26454 req-1d41caf6-239e-4608-a823-614537b3fe0e tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 945.704516] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 945.704516] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.704516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.704516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.704764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.704900] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.705013] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.705094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.705253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.705332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.705422] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.984320] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 945.984538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.208900] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.392671] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 946.392992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.393179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.393462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.393698] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.393845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.393915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.394171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.394252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394423] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.711387] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.897558] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.898266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.898266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.898266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.898481] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.898627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.898692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.898867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.898965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.899094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.899266] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.899365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.899408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.899575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.899861] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.899861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.899861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.900540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.900540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.900540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.900540] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.156592] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 947.156776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.157058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.157237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.157452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.157584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.157651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.157809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.157898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.158020] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.214920] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.215272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.215320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.215622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.215777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.215935] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 947.258385] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.258569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.258612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.259153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.259310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.276656] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 947.404617] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6866765e-0cdc-4d35-aa21-1b0f99339ef0: rpc.has_security_group_logging(os_id): False [ 947.427892] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.428682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.428682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.428682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.428682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.428945] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.429733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.429838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.430150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.430150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.430363] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.430456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.430514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.430705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.430771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.431011] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.431114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.431307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.431367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.431473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.431556] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 947.497815] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.497969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.498097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.498308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.498458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.515904] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 947.661405] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.662030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.662162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.662498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.662646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.662973] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.663162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.663272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.663519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.663640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.663783] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 947.694224] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.694402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.694491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.694757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.694954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.707417] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 949.290241] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 949.290513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.531267] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 949.531545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.721221] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 949.721221] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 deletion is rescheduled due to dependency. [ 949.721221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.705403] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 950.705834] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 953.966589] env[65992]: INFO networking_nsxv3.common.synchronization [req-fea19d0d-9dbd-4fac-b8c6-0b7aa67ce3f3 req-9cb1f2a7-43eb-47ce-b1ca-6a675dbc4718 tempest-ServersNegativeTestJSON-1286688584 tempest-ServersNegativeTestJSON-1286688584-project-member] Enqueued Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 953.967434] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 with Priority: HIGHEST for action security_group_members [ 953.967822] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.967990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.968638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.968951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.969108] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.969214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.969253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.969409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.969494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.969587] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.216613] env[65992]: INFO networking_nsxv3.common.synchronization [None req-2de3d283-ff16-4b0a-ae31-3abf92007c75 None None] Enqueued Resource ID: 2b74921a-d342-4c25-8802-34d60151b707 with Priority: HIGHEST for action port [ 954.216613] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b74921a-d342-4c25-8802-34d60151b707 with Priority: HIGHEST for action port [ 954.216613] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b74921a-d342-4c25-8802-34d60151b707 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.216613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b74921a-d342-4c25-8802-34d60151b707" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.216613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b74921a-d342-4c25-8802-34d60151b707" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.218435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b74921a-d342-4c25-8802-34d60151b707" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.218435] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b74921a-d342-4c25-8802-34d60151b707',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.271308] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a6611d2-15df-42e7-8eb0-74b14eb4ed2f req-e1fb8fde-87c7-4f84-b912-c944780e565d tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_members [ 954.271308] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_members [ 954.271603] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.271919] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.272134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.272501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.272781] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.273019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.273185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.273513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.273745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.273994] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.474714] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.474938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.475049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.475354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.500102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.500493] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.500685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.500965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.501106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.501251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.501428] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 is going to be updated. [ 954.529547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.529742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.529742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.529936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.530222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.542058] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: IN_PROGRESS for 2s [ 954.679735] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.679940] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.680160] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.680454] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.680714] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.680907] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.680979] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.681212] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.681365] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.681622] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.681761] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.681864] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.681942] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.682060] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.682208] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.682299] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.706902] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.707135] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.707306] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.707594] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.707820] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.708041] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.708186] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.708493] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.708630] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2465eb6e-89d0-44b4-99b6-9b1f64e101f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.719557] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b74921a-d342-4c25-8802-34d60151b707 [ 954.719998] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.719998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.719998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.720207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.720283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.720367] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b74921a-d342-4c25-8802-34d60151b707 already deleted. [ 954.720459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b74921a-d342-4c25-8802-34d60151b707" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.779500] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.779500] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.779500] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 already deleted. [ 954.779500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.899648] env[65992]: INFO networking_nsxv3.common.synchronization [req-a94ff2b8-89c5-4d6d-93ab-635573af5663 req-fc244d40-5bc3-48d4-ba28-7d948f623321 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 954.899821] env[65992]: INFO networking_nsxv3.common.synchronization [req-a94ff2b8-89c5-4d6d-93ab-635573af5663 req-fc244d40-5bc3-48d4-ba28-7d948f623321 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGHEST for action security_group_members [ 954.900090] env[65992]: INFO networking_nsxv3.common.synchronization [req-a94ff2b8-89c5-4d6d-93ab-635573af5663 req-fc244d40-5bc3-48d4-ba28-7d948f623321 tempest-SecurityGroupsTestJSON-1880506520 tempest-SecurityGroupsTestJSON-1880506520-project-member] Enqueued Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 954.900529] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 with Priority: HIGHEST for action security_group_members [ 954.900665] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGHEST for action security_group_members [ 954.900763] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 with Priority: HIGHEST for action security_group_members [ 954.901547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.901547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.901547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.901547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.901547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.901990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.901990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.901990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.901990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.901990] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8abc7e6f-b99b-4856-9c2c-59b9b0971df3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.904477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb22631e-4990-471c-96cc-e4e5b0939818 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.904477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.904477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.904477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.904477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.904477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.904477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.904477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.904477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.904477] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.905609] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.905609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.905609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.907112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.907112] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.907244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.907244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.907356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.907411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.909050] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f8fddf5-e496-4959-a3e0-b872a3fbc0e7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.213407] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.213771] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.213872] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.214128] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.214338] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.214504] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 2465eb6e-89d0-44b4-99b6-9b1f64e101f8 not found, creating... [ 955.214771] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.214929] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.215059] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.215319] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.215479] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.215795] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.215987] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.216615] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.216839] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.216977] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.217256] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 2465eb6e-89d0-44b4-99b6-9b1f64e101f8 is going to be created. [ 955.239626] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.239844] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.239967] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.240304] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.240523] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.240755] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.409502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.410662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.410662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.410662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.411825] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.411974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.412426] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.412520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.438121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.438439] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.438548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.438636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.438822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.438970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.439219] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 is going to be updated. [ 955.440458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.440652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.469249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.469249] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.469249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.469249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.469487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.469487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.469554] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb22631e-4990-471c-96cc-e4e5b0939818 is going to be updated. [ 955.470681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.471055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.471055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.471427] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.471547] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.471616] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.471774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.471861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.471937] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 is going to be updated. [ 955.505622] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.505776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.505860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.506085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.506227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.521801] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: IN_PROGRESS for 2s [ 955.522543] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.522683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.522753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.522959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.523174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.525961] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.526130] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.526234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.526370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.526555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.538814] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: IN_PROGRESS for 2s [ 955.538814] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb22631e-4990-471c-96cc-e4e5b0939818 in Status: IN_PROGRESS for 2s [ 955.973580] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a6611d2-15df-42e7-8eb0-74b14eb4ed2f req-39fa0140-c73a-47c1-a484-9db949cd5324 service nova] Enqueued Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_rules [ 955.973823] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a6611d2-15df-42e7-8eb0-74b14eb4ed2f req-39fa0140-c73a-47c1-a484-9db949cd5324 service nova] Enqueued Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_members [ 955.973985] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a6611d2-15df-42e7-8eb0-74b14eb4ed2f req-39fa0140-c73a-47c1-a484-9db949cd5324 service nova] Enqueued Resource ID: 2465eb6e-89d0-44b4-99b6-9b1f64e101f8 with Priority: HIGHEST for action port [ 955.974866] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_rules [ 955.975209] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_members [ 955.975380] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2465eb6e-89d0-44b4-99b6-9b1f64e101f8 with Priority: HIGHEST for action port [ 955.975758] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.975906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.975993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.976212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.976289] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.977182] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.977808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.977808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.977808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.977808] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.977808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.977808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.978066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.978066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.978292] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.980120] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.980120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.980319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.980383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.980449] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2465eb6e-89d0-44b4-99b6-9b1f64e101f8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.482909] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.483251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.483584] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.484615] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2465eb6e-89d0-44b4-99b6-9b1f64e101f8 with status ACTIVE [ 956.484749] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.484941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.485017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.485223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.485331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.485882] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.485882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.485882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.485882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.486128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.486128] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.486210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.486254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.486387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.486459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.486539] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2465eb6e-89d0-44b4-99b6-9b1f64e101f8 is going to be updated. [ 956.507744] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.507922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.507970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.508240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.508398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.508590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2465eb6e-89d0-44b4-99b6-9b1f64e101f8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.553130] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 in Status: SUCCESS [ 956.553298] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6 deletion is rescheduled due to dependency. [ 956.553372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.988571] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.084814] env[65992]: INFO networking_nsxv3.common.synchronization [None req-52bb8c3f-6cc4-48e6-a3c0-fc193c0dac5b None None] Enqueued Resource ID: 4ab6bdaf-10e6-4b01-9149-dff1013b7498 with Priority: HIGHEST for action port [ 957.084814] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ab6bdaf-10e6-4b01-9149-dff1013b7498 with Priority: HIGHEST for action port [ 957.084814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ab6bdaf-10e6-4b01-9149-dff1013b7498 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.084814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ab6bdaf-10e6-4b01-9149-dff1013b7498" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.084814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ab6bdaf-10e6-4b01-9149-dff1013b7498" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.084814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ab6bdaf-10e6-4b01-9149-dff1013b7498" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.084814] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ab6bdaf-10e6-4b01-9149-dff1013b7498',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.238677] env[65992]: INFO networking_nsxv3.common.synchronization [req-74f40acc-27ec-46bc-9bea-f5add6d572dc req-ef5fbb0e-b353-4768-b54e-149e97bf067e tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 957.239515] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 957.239975] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.240179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.240299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.240595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.240855] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.241037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.241150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.241402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.241557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.241719] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.490986] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.491425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.491425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.492871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.492871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.492871] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 is going to be created. [ 957.519314] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.519481] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.519527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.519730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.519888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.536595] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 in Status: UNINITIALIZED for 2s [ 957.542473] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 in Status: SUCCESS [ 957.542715] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8abc7e6f-b99b-4856-9c2c-59b9b0971df3 deletion is rescheduled due to dependency. [ 957.542859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8abc7e6f-b99b-4856-9c2c-59b9b0971df3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.552694] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb22631e-4990-471c-96cc-e4e5b0939818 in Status: SUCCESS [ 957.552694] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb22631e-4990-471c-96cc-e4e5b0939818 deletion is rescheduled due to dependency. [ 957.552694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.553669] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 in Status: SUCCESS [ 957.554424] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f8fddf5-e496-4959-a3e0-b872a3fbc0e7 deletion is rescheduled due to dependency. [ 957.554424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f8fddf5-e496-4959-a3e0-b872a3fbc0e7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.586394] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ab6bdaf-10e6-4b01-9149-dff1013b7498 [ 957.586653] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.586840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.586886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.587103] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.587201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.587306] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ab6bdaf-10e6-4b01-9149-dff1013b7498 already deleted. [ 957.587397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ab6bdaf-10e6-4b01-9149-dff1013b7498" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.746436] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.746436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.746436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.746436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.746436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.746436] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.746436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.746436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.746436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.746822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.746822] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 957.778659] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.778659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.778659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.778659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.779033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.798197] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 959.547962] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 in Status: SUCCESS [ 959.548304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.548587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.549174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.549174] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.549316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.549364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.549544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.549657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.549714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.549888] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.811122] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 959.811485] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 959.811716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.053639] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.457321] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2a5193b-3128-42e3-b417-0610068d32c2 req-1fcd998a-a0b5-4739-a990-146be5d3927d tempest-ServersWithSpecificFlavorTestJSON-1648883113 tempest-ServersWithSpecificFlavorTestJSON-1648883113-project-member] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 960.458043] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGHEST for action security_group_members [ 960.458413] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.458570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.458666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.458898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.459137] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.459302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.459391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.459580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.459709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.459834] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.555818] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09fa0638-1a13-4fbd-a918-e188dff752a0: rpc.has_security_group_logging(os_id): False [ 960.577979] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.578232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.578232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.578480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.578588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.578832] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.578956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.579027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.579215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.579327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.579454] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 is going to be created. [ 960.668440] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.668664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.668664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.668895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.669156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.681365] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 in Status: IN_PROGRESS for 2s [ 960.963523] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.963523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.963523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.963523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.996271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.996271] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.996271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.996271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.996271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.996271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.996271] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be updated. [ 961.061896] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.061896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.061896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.062143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.062213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.078302] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: IN_PROGRESS for 2s [ 961.908418] env[65992]: INFO networking_nsxv3.common.synchronization [req-5094cc71-bb21-4dfe-a0fc-26aa7306342b req-c34021ef-cfd2-4bc1-861b-7d2252e7e89e tempest-ImagesOneServerNegativeTestJSON-1206007642 tempest-ImagesOneServerNegativeTestJSON-1206007642-project-member] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 961.909198] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 961.909597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.909830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.910424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.910424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.910424] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.910602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.910680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.910900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.911222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.911222] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.042668] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a251189-14d7-45a1-8828-673891016cdb req-ec291f42-5adf-467b-876f-204084798350 tempest-ServerRescueTestJSON-228920212 tempest-ServerRescueTestJSON-228920212-project-member] Enqueued Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 962.043341] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 962.043880] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.044037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.044122] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.044345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.044504] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.044603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.044664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.044817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.044898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.044990] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.415686] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.415913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.415979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.416195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.416317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.416572] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.416683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.416750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.417023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.417161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.417261] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 962.455148] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.455338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.455454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.455667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.455821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.459838] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-27 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.460108] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-27" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.460236] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-27" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.460658] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-27" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.460912] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.461183] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.461310] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.461521] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.461662] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.461862] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.461971] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.462088] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.462254] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.462291] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.462391] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.462515] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.465747] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 962.476782] env[65992]: INFO networking_nsxv3.common.synchronization [req-130f6d24-9bcc-47cd-b0cf-37608e62109e req-c80b0211-0d25-4a7a-aa79-f2c8f44d1b8f tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 962.477313] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 962.477673] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.477800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.477869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.478092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.478244] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.478492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.478492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.478580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.478614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.478707] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.482732] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.482876] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.483016] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.483187] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-27" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.483461] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-34982213-08ce-4e47-9b78-27babe4b0118 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.484194] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-34982213-08ce-4e47-9b78-27babe4b0118" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.484194] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-34982213-08ce-4e47-9b78-27babe4b0118" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.484194] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-34982213-08ce-4e47-9b78-27babe4b0118" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.484194] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34982213-08ce-4e47-9b78-27babe4b0118',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.548357] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.693803] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 in Status: SUCCESS [ 962.694153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.981653] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.982023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.982023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.982182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.988207] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.988401] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.988527] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.988781] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.988927] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.989153] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 34982213-08ce-4e47-9b78-27babe4b0118 not found, creating... [ 962.989427] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.989588] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.989705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.989930] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.990082] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.990403] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.990562] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.990676] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.990873] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.990998] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.991215] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 34982213-08ce-4e47-9b78-27babe4b0118 is going to be created. [ 963.004151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.004406] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.004521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.004581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.004774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.004866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.004984] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 963.015659] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.015875] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.016042] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.016313] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.016533] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.016746] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-34982213-08ce-4e47-9b78-27babe4b0118" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.034397] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.034623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.034745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.034982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.035158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.045899] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 963.050072] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.086755] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 in Status: SUCCESS [ 963.086941] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 deletion is rescheduled due to dependency. [ 963.087160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.552217] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.552415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.552528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.552773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.552893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.552997] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 is going to be updated. [ 963.589844] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.590093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.590093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.590360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.590553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.603502] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: IN_PROGRESS for 2s [ 963.724198] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a251189-14d7-45a1-8828-673891016cdb req-b5b807c9-50e3-406f-9799-0f3caf507c9c service nova] Enqueued Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_rules [ 963.724308] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a251189-14d7-45a1-8828-673891016cdb req-b5b807c9-50e3-406f-9799-0f3caf507c9c service nova] Enqueued Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 963.724441] env[65992]: INFO networking_nsxv3.common.synchronization [req-3a251189-14d7-45a1-8828-673891016cdb req-b5b807c9-50e3-406f-9799-0f3caf507c9c service nova] Enqueued Resource ID: 34982213-08ce-4e47-9b78-27babe4b0118 with Priority: HIGHEST for action port [ 963.724675] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_rules [ 963.724796] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 963.724891] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34982213-08ce-4e47-9b78-27babe4b0118 with Priority: HIGHEST for action port [ 963.725441] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.725595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.725627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.725817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.725927] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.726749] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.726825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.726971] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-34982213-08ce-4e47-9b78-27babe4b0118 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.727115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34982213-08ce-4e47-9b78-27babe4b0118" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.727251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34982213-08ce-4e47-9b78-27babe4b0118" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.727339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34982213-08ce-4e47-9b78-27babe4b0118" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.727411] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34982213-08ce-4e47-9b78-27babe4b0118',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.229745] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.230268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.230268] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34982213-08ce-4e47-9b78-27babe4b0118 with status ACTIVE [ 964.230358] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.230455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.230517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.230717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.230805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.230970] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.231210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.231210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.231434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.231523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.231707] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.231801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.231863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.232015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.232088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.232173] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34982213-08ce-4e47-9b78-27babe4b0118 is going to be updated. [ 964.253788] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.253788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.253788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.254282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.254282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.254282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34982213-08ce-4e47-9b78-27babe4b0118" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.476601] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 964.476796] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 deletion is rescheduled due to dependency. [ 964.476879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.057104] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 965.057295] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a deletion is rescheduled due to dependency. [ 965.057472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.614552] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: SUCCESS [ 965.614961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.614961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.615174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.615363] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.615487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.615616] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.615792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.615874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.615967] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.119485] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.623316] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.105945] env[65992]: INFO networking_nsxv3.common.synchronization [req-26e0ace9-33ac-40a3-8d34-482ef913f0fd req-edb9be54-0aa3-4243-9b72-5562e2026587 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 967.106473] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 967.106864] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.106934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.107000] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.107194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.107351] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.107453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.107518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.107667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.107749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.107836] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.126099] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.126572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.126646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.126942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.127055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.127166] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 is going to be updated. [ 967.161195] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.161195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.161195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.161520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.161818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.172292] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: IN_PROGRESS for 2s [ 967.523286] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.523519] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.523590] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.523824] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.524089] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.524258] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.524483] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.524723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.524914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.525153] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.525263] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.525368] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.525472] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.525603] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.525793] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.526017] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.546847] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.549195] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.549195] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.549195] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.549195] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-01aa71b0-7813-493c-9e11-ab114e98dce7 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.549195] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-01aa71b0-7813-493c-9e11-ab114e98dce7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.549195] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-01aa71b0-7813-493c-9e11-ab114e98dce7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.549195] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-01aa71b0-7813-493c-9e11-ab114e98dce7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.549195] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01aa71b0-7813-493c-9e11-ab114e98dce7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.610458] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.052944] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.052944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.052944] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.053370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.053370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.053370] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 01aa71b0-7813-493c-9e11-ab114e98dce7 not found, creating... [ 968.053630] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.053788] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.053936] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.054202] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.054343] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.054650] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.054808] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.054923] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.055162] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.055337] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.055613] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 01aa71b0-7813-493c-9e11-ab114e98dce7 is going to be created. [ 968.076051] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.076247] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.076247] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.076517] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.076749] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.076971] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-01aa71b0-7813-493c-9e11-ab114e98dce7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.112752] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.615275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.615463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.615504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.615745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.615834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.615939] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 968.649888] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.650082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.650082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.650319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.650474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.662956] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 968.795290] env[65992]: INFO networking_nsxv3.common.synchronization [req-26e0ace9-33ac-40a3-8d34-482ef913f0fd req-e831c913-0118-4fc0-96c7-4feee64d8f36 service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 968.795290] env[65992]: INFO networking_nsxv3.common.synchronization [req-26e0ace9-33ac-40a3-8d34-482ef913f0fd req-e831c913-0118-4fc0-96c7-4feee64d8f36 service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 968.795290] env[65992]: INFO networking_nsxv3.common.synchronization [req-26e0ace9-33ac-40a3-8d34-482ef913f0fd req-e831c913-0118-4fc0-96c7-4feee64d8f36 service nova] Enqueued Resource ID: 01aa71b0-7813-493c-9e11-ab114e98dce7 with Priority: HIGHEST for action port [ 968.795290] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 968.795290] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 968.795290] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01aa71b0-7813-493c-9e11-ab114e98dce7 with Priority: HIGHEST for action port [ 968.795694] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.795694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.795694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.795804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.798323] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.800619] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.800619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.800746] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-01aa71b0-7813-493c-9e11-ab114e98dce7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.800828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01aa71b0-7813-493c-9e11-ab114e98dce7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.800864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01aa71b0-7813-493c-9e11-ab114e98dce7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.801218] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01aa71b0-7813-493c-9e11-ab114e98dce7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.804461] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01aa71b0-7813-493c-9e11-ab114e98dce7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.183544] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: SUCCESS [ 969.183943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.183943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.184199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.184381] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.184501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.184565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.184706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.184785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.184863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.184952] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.304392] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.304560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.306845] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01aa71b0-7813-493c-9e11-ab114e98dce7 with status ACTIVE [ 969.307061] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.307175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.307237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.307452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.307540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.307721] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.307822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.307928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.308047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.308119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.308309] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.308395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.308452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.308669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.308669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.308835] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01aa71b0-7813-493c-9e11-ab114e98dce7 is going to be updated. [ 969.331144] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.331362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.331408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.331661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.331799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.331952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01aa71b0-7813-493c-9e11-ab114e98dce7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.688195] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.688195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.688195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.692838] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.692838] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.692838] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.692838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.692838] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.193567] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc75e044-2bf1-4d6d-8a88-0619925a4394: rpc.has_security_group_logging(os_id): False [ 970.215016] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.215016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.215016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.215016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.235106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.236502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.236502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.236502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.236502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.236502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.236502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.236502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.236502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.236502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.236502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.236502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.237479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.237479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.237479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.237479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.237479] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 is going to be updated. [ 970.306348] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.306590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.306590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.306899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.306963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.320474] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: IN_PROGRESS for 2s [ 970.674207] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 970.674207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.674444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.675029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.675029] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.675029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.675029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.675243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.675243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.675380] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.177786] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.680571] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.184481] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.184703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.184804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.186502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.186502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.186502] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 972.218376] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.218376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.218634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.218634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.218822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.228212] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 972.336058] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: SUCCESS [ 972.336058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.599179] env[65992]: INFO networking_nsxv3.common.synchronization [req-5e8f2b14-91cf-4e2c-aa43-bab6cc8ffd89 req-6ded57f1-8e49-40d4-814d-02c43646d11d tempest-InstanceActionsNegativeTestJSON-994043228 tempest-InstanceActionsNegativeTestJSON-994043228-project-member] Enqueued Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGHEST for action security_group_members [ 973.599808] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGHEST for action security_group_members [ 973.600159] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.600330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.600402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.600649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.600821] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.600925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.600976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.601140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.601240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.601307] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.953356] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.953549] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-446" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.953641] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-446" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.953978] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-446" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.954627] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.954791] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.954914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.955183] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.955404] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.958713] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.958713] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.958713] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.958713] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.958713] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.958713] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.958713] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.976740] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.977033] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 973.977353] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.977616] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-446" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.977975] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.978242] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.978460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.978812] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.978947] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c2a395f-613d-4f40-9dec-fcdfb14d5b7e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.109030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.109030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.109030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.109030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.109030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.109519] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.109519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.109519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.109658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.109702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.109776] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e already deleted. [ 974.110286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.238635] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 4s [ 974.482861] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.482861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.482861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.483703] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.483703] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.483703] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 4c2a395f-613d-4f40-9dec-fcdfb14d5b7e not found, creating... [ 974.483703] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.483857] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.484475] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.484475] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.484475] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.484824] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.485433] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.485433] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.485433] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.485637] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.485846] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 4c2a395f-613d-4f40-9dec-fcdfb14d5b7e is going to be created. [ 974.509373] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.509637] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.509806] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.510097] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.510341] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.510569] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.217090] env[65992]: INFO networking_nsxv3.common.synchronization [req-5e8f2b14-91cf-4e2c-aa43-bab6cc8ffd89 req-f498503a-8758-495c-919c-237a44edb174 service nova] Enqueued Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGHEST for action security_group_rules [ 975.217434] env[65992]: INFO networking_nsxv3.common.synchronization [req-5e8f2b14-91cf-4e2c-aa43-bab6cc8ffd89 req-f498503a-8758-495c-919c-237a44edb174 service nova] Enqueued Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGHEST for action security_group_members [ 975.217496] env[65992]: INFO networking_nsxv3.common.synchronization [req-5e8f2b14-91cf-4e2c-aa43-bab6cc8ffd89 req-f498503a-8758-495c-919c-237a44edb174 service nova] Enqueued Resource ID: 4c2a395f-613d-4f40-9dec-fcdfb14d5b7e with Priority: HIGHEST for action port [ 975.218650] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGHEST for action security_group_rules [ 975.218650] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGHEST for action security_group_members [ 975.218650] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c2a395f-613d-4f40-9dec-fcdfb14d5b7e with Priority: HIGHEST for action port [ 975.219079] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.219198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.219298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.219894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.219894] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.221552] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.221721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.221819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.222048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.222268] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.226263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.226263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.226263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.226263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.226263] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.226263] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.226263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.226263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.226263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.226263] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c2a395f-613d-4f40-9dec-fcdfb14d5b7e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.722768] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.722768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.728997] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c2a395f-613d-4f40-9dec-fcdfb14d5b7e with status ACTIVE [ 975.729269] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.729408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.729863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.729863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.729863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.730120] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.730205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.730205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.731696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.731696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.731696] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.731696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.731696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.731696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.731696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.731696] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c2a395f-613d-4f40-9dec-fcdfb14d5b7e is going to be updated. [ 975.732264] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.754741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.754927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.754927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.755147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.755281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.755488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c2a395f-613d-4f40-9dec-fcdfb14d5b7e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.212807] env[65992]: INFO networking_nsxv3.common.synchronization [None req-7c7111a0-5659-46df-b754-8dc91bb443c8 None None] Enqueued Resource ID: cf994e9a-f9d9-4cca-af05-208395afedab with Priority: HIGHEST for action port [ 976.213386] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf994e9a-f9d9-4cca-af05-208395afedab with Priority: HIGHEST for action port [ 976.214106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf994e9a-f9d9-4cca-af05-208395afedab taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.214543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf994e9a-f9d9-4cca-af05-208395afedab" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.214543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf994e9a-f9d9-4cca-af05-208395afedab" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.214734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf994e9a-f9d9-4cca-af05-208395afedab" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.214734] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf994e9a-f9d9-4cca-af05-208395afedab',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.234672] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.252338] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 976.252338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.252338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.252338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.252338] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.252338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.252338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.252338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.252338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.252338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.252338] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.717694] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf994e9a-f9d9-4cca-af05-208395afedab [ 976.717970] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.718141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.718200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.718387] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.718478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.718660] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf994e9a-f9d9-4cca-af05-208395afedab already deleted. [ 976.719261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf994e9a-f9d9-4cca-af05-208395afedab" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.739014] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.739138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.740258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.740258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.740258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.740258] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e is going to be created. [ 976.755408] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.755556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.755627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.755837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.756009] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.756186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.756282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.756395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.756477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.756566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.756741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.756834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.756888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.757039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.757208] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.757302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.757361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.757496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.757569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.757644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.757728] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.768349] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.768349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.768349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.768349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.768349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.782174] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e in Status: UNINITIALIZED for 2s [ 976.982022] env[65992]: INFO networking_nsxv3.common.synchronization [None req-7adc0e9a-0982-43cc-9f81-9f256f215d6e tempest-ServerActionsTestOtherB-918399856 tempest-ServerActionsTestOtherB-918399856-project-member] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 976.983020] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 976.983020] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.983020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.983020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.983271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.983357] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.064684] env[65992]: INFO networking_nsxv3.common.synchronization [None req-0d09059f-e5db-4213-b057-f8da80857a7b tempest-ServerActionsTestOtherB-918399856 tempest-ServerActionsTestOtherB-918399856-project-member] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 977.064684] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 977.064684] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.065021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.259663] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6417014f-241b-4b36-8b7b-aeef9e200013: rpc.has_security_group_logging(os_id): False [ 977.281597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.282019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.282124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.282357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.320028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.320028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.320028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.320028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.320028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.320028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.320028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.320028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.320028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.320028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.320752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.321180] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.321420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.321571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.321817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.321998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.322203] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 977.409902] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.410099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.410171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.410348] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.410494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.429652] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 977.507466] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.507673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.507673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.507889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.507988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.508097] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c already deleted. [ 977.508179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.509671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.509868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.509958] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.007561] env[65992]: INFO networking_nsxv3.common.synchronization [req-66f73869-8799-44c8-828c-5c7a6221c216 req-fcc6815d-b54f-4108-85e7-6f2140c30f64 tempest-MultipleCreateTestJSON-1501668855 tempest-MultipleCreateTestJSON-1501668855-project-member] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 978.008129] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 978.008491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.008619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.008689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.008889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.009056] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.009203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.009274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.009420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.009504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.009597] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.031935] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.031935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.031935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.031935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.032158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.032158] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c already deleted. [ 978.032226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.440349] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.440683] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.440683] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.440914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.441179] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.441338] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.441454] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.442636] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.443093] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.443977] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.445053] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.445053] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.445053] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.445053] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.445053] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.445053] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.467425] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.468282] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.468464] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.468676] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.468982] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-becf3498-2fba-4852-a87b-554b6deaaa43 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.469234] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-becf3498-2fba-4852-a87b-554b6deaaa43" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.469593] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-becf3498-2fba-4852-a87b-554b6deaaa43" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.469705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-becf3498-2fba-4852-a87b-554b6deaaa43" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.469841] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('becf3498-2fba-4852-a87b-554b6deaaa43',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.513983] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.513983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.513983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.513983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.513983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.514268] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.514864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.515311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.515824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.516432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.516546] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 978.551086] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.551086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.551086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.551086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.551086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.560725] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 978.763567] env[65992]: INFO networking_nsxv3.common.synchronization [None req-9df7d72a-5dcc-4954-bdfc-25e0480e5c1f None None] Enqueued Resource ID: ad2e4235-c6cc-4801-bdf8-91c02f28f906 with Priority: HIGHEST for action port [ 978.763567] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad2e4235-c6cc-4801-bdf8-91c02f28f906 with Priority: HIGHEST for action port [ 978.764590] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad2e4235-c6cc-4801-bdf8-91c02f28f906 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.764721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad2e4235-c6cc-4801-bdf8-91c02f28f906" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.765945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad2e4235-c6cc-4801-bdf8-91c02f28f906" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.765945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad2e4235-c6cc-4801-bdf8-91c02f28f906" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.765945] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad2e4235-c6cc-4801-bdf8-91c02f28f906',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.792326] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e in Status: SUCCESS [ 978.792542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.792742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.792904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.793107] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.793238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.793296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.793456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.793524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.793611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.793697] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.973353] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.973805] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.975723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.975723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.975723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.975723] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port becf3498-2fba-4852-a87b-554b6deaaa43 not found, creating... [ 978.976153] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.976153] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.976153] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.976329] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.976471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.976776] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.976932] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.977428] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.977909] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.977909] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.978072] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: becf3498-2fba-4852-a87b-554b6deaaa43 is going to be created. [ 979.023029] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.023029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.023251] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.023386] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.023620] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.023914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-becf3498-2fba-4852-a87b-554b6deaaa43" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.267712] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad2e4235-c6cc-4801-bdf8-91c02f28f906 [ 979.268034] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.268196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.268282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.268518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.268632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.268753] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad2e4235-c6cc-4801-bdf8-91c02f28f906 already deleted. [ 979.268841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad2e4235-c6cc-4801-bdf8-91c02f28f906" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.297101] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.297317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.297317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.297526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.297693] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.297794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.297966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.298161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.298295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.298364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.298519] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.298615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.298677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.298816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.298959] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.299078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.299141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.299450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.299534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.299617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.299710] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.445141] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 979.445501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.729850] env[65992]: INFO networking_nsxv3.common.synchronization [req-66f73869-8799-44c8-828c-5c7a6221c216 req-e47d8569-0027-428b-b112-a514165600ef service nova] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_rules [ 979.729850] env[65992]: INFO networking_nsxv3.common.synchronization [req-66f73869-8799-44c8-828c-5c7a6221c216 req-e47d8569-0027-428b-b112-a514165600ef service nova] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 979.729850] env[65992]: INFO networking_nsxv3.common.synchronization [req-66f73869-8799-44c8-828c-5c7a6221c216 req-e47d8569-0027-428b-b112-a514165600ef service nova] Enqueued Resource ID: becf3498-2fba-4852-a87b-554b6deaaa43 with Priority: HIGHEST for action port [ 979.729850] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_rules [ 979.730334] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 979.730334] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: becf3498-2fba-4852-a87b-554b6deaaa43 with Priority: HIGHEST for action port [ 979.730820] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.731030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.731183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.731476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.731959] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.733024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.733997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.734368] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-becf3498-2fba-4852-a87b-554b6deaaa43 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.734577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-becf3498-2fba-4852-a87b-554b6deaaa43" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.734708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-becf3498-2fba-4852-a87b-554b6deaaa43" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.735054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-becf3498-2fba-4852-a87b-554b6deaaa43" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.735197] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('becf3498-2fba-4852-a87b-554b6deaaa43',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.802170] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e: rpc.has_security_group_logging(os_id): False [ 979.823533] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.823795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.823886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.824151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.824456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.824535] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.825076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.825076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.825076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.825076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.825293] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.825396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.825448] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.825594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.825697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.825947] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.826123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.826215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.826438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.826550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.826648] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e is going to be created. [ 979.895372] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.895619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.895619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.895821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.896019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.909016] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e in Status: IN_PROGRESS for 2s [ 980.237222] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.237404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.238662] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port becf3498-2fba-4852-a87b-554b6deaaa43 with status ACTIVE [ 980.238845] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.238959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.239042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.239294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.239401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.239583] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.239700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.239786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.239920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.239996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.240214] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.240310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.240372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.240511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.240584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.240665] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: becf3498-2fba-4852-a87b-554b6deaaa43 is going to be updated. [ 980.264186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.264376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.264439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.264599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.264745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.264903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-becf3498-2fba-4852-a87b-554b6deaaa43" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.573536] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 980.573840] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 deletion is rescheduled due to dependency. [ 980.573840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.574031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.574220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.574407] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.574551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.574620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.574774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.574857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.574951] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.597014] env[65992]: INFO networking_nsxv3.common.synchronization [req-66f73869-8799-44c8-828c-5c7a6221c216 req-f6711836-dd45-4200-b193-78a3767a44b1 tempest-MultipleCreateTestJSON-1501668855 tempest-MultipleCreateTestJSON-1501668855-project-member] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 980.597559] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 980.597863] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.598197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.900728] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.900950] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.901089] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.901711] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.902025] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.902189] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.902303] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.903041] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.903041] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.903041] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.903041] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.903291] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.903291] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.903291] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.903475] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.903560] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.931872] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.932072] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.932194] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.932395] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.932798] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-05631dec-0219-44cd-ad66-60e4b579dfd1 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.932994] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-05631dec-0219-44cd-ad66-60e4b579dfd1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.933206] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-05631dec-0219-44cd-ad66-60e4b579dfd1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.933611] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-05631dec-0219-44cd-ad66-60e4b579dfd1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.933995] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05631dec-0219-44cd-ad66-60e4b579dfd1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.077875] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.436423] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.436663] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.436789] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.437144] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.437321] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.437480] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 05631dec-0219-44cd-ad66-60e4b579dfd1 not found, creating... [ 981.437743] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.437903] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.438031] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.438258] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.438436] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.438683] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.438839] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.438953] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.439166] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.439321] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.439460] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 05631dec-0219-44cd-ad66-60e4b579dfd1 is going to be created. [ 981.461255] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.461479] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.461633] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.461919] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.462160] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.462381] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-05631dec-0219-44cd-ad66-60e4b579dfd1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.580359] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.921156] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e in Status: SUCCESS [ 981.921449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.083584] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.083788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.083898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.084112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.084204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.084306] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 982.117394] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.117394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.117394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.117394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.117394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.125661] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 982.222856] env[65992]: INFO networking_nsxv3.common.synchronization [req-66f73869-8799-44c8-828c-5c7a6221c216 req-e2202012-c2f8-4dd3-af4e-8492ff53c639 service nova] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_rules [ 982.223129] env[65992]: INFO networking_nsxv3.common.synchronization [req-66f73869-8799-44c8-828c-5c7a6221c216 req-e2202012-c2f8-4dd3-af4e-8492ff53c639 service nova] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 982.223276] env[65992]: INFO networking_nsxv3.common.synchronization [req-66f73869-8799-44c8-828c-5c7a6221c216 req-e2202012-c2f8-4dd3-af4e-8492ff53c639 service nova] Enqueued Resource ID: 05631dec-0219-44cd-ad66-60e4b579dfd1 with Priority: HIGHEST for action port [ 982.223825] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_rules [ 982.223958] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 982.224080] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05631dec-0219-44cd-ad66-60e4b579dfd1 with Priority: HIGHEST for action port [ 982.224350] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.224453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.225113] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.225224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.225414] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-05631dec-0219-44cd-ad66-60e4b579dfd1 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.225534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05631dec-0219-44cd-ad66-60e4b579dfd1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.225662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05631dec-0219-44cd-ad66-60e4b579dfd1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.225799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05631dec-0219-44cd-ad66-60e4b579dfd1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.225882] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05631dec-0219-44cd-ad66-60e4b579dfd1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.728095] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05631dec-0219-44cd-ad66-60e4b579dfd1 with status ACTIVE [ 982.728415] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.728531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.728531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.728809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.728900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.729262] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.729495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.729495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.729569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.729636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.729830] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.729924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.730042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.730128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.730203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.730275] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05631dec-0219-44cd-ad66-60e4b579dfd1 is going to be updated. [ 982.752680] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.752845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.752905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.753861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.753861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.753861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05631dec-0219-44cd-ad66-60e4b579dfd1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.139988] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 984.142211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.143276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.143276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.143276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.143614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.143797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.144099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.144273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.144491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.144666] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.145795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.146095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.146376] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.146554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.146666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.146925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.147486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.147486] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.650106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.650106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.652334] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.040153] env[65992]: INFO networking_nsxv3.common.synchronization [req-468612a4-72e6-445b-9242-b243f6c8e66d req-27414cfc-9353-41e0-a3c4-761cc992140d tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 985.040858] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 985.041783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.041783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.041783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.041783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.042022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.042133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.042133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.042418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.042514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.042609] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.155025] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.410011] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-711 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.410285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.410465] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.410758] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.411055] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.411269] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.411418] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.411675] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.411849] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.412101] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.412241] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.412371] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.412498] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.412627] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.412751] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.412902] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.438447] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.438612] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.438731] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.438903] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-711" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.439270] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-2e4213ba-4dea-434d-968d-437e7fb56516 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.439448] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-2e4213ba-4dea-434d-968d-437e7fb56516" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.439580] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-2e4213ba-4dea-434d-968d-437e7fb56516" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.440043] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-2e4213ba-4dea-434d-968d-437e7fb56516" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.440198] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e4213ba-4dea-434d-968d-437e7fb56516',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.545750] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.545975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.546118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.546333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.546842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.546842] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.546842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.546842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.547132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.547132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.547214] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 985.576614] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.576764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.576831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.577185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.577409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.590359] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 985.657339] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.657695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.657695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.658089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.658089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.658300] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 985.697594] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.697594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.697594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.697594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.697594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.728368] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 985.943020] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.943439] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.943739] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.944169] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.944460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.944660] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 2e4213ba-4dea-434d-968d-437e7fb56516 not found, creating... [ 985.945125] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.945414] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.945620] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.946046] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.946428] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.946959] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.947294] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.947548] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.947959] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.948304] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.948558] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 2e4213ba-4dea-434d-968d-437e7fb56516 is going to be created. [ 985.972998] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.973372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.973551] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.973947] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.974245] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.974568] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-2e4213ba-4dea-434d-968d-437e7fb56516" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.676398] env[65992]: INFO networking_nsxv3.common.synchronization [req-468612a4-72e6-445b-9242-b243f6c8e66d req-c16b78f0-9dcf-4eec-9e14-6487afa44051 service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 986.676398] env[65992]: INFO networking_nsxv3.common.synchronization [req-468612a4-72e6-445b-9242-b243f6c8e66d req-c16b78f0-9dcf-4eec-9e14-6487afa44051 service nova] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 986.677118] env[65992]: INFO networking_nsxv3.common.synchronization [req-468612a4-72e6-445b-9242-b243f6c8e66d req-c16b78f0-9dcf-4eec-9e14-6487afa44051 service nova] Enqueued Resource ID: 2e4213ba-4dea-434d-968d-437e7fb56516 with Priority: HIGHEST for action port [ 986.677118] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_rules [ 986.677118] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 986.677118] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e4213ba-4dea-434d-968d-437e7fb56516 with Priority: HIGHEST for action port [ 986.677698] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.677847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.677899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.678198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.678198] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.679469] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.679469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.679469] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e4213ba-4dea-434d-968d-437e7fb56516 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.679653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e4213ba-4dea-434d-968d-437e7fb56516" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.679653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e4213ba-4dea-434d-968d-437e7fb56516" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.679825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e4213ba-4dea-434d-968d-437e7fb56516" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.679901] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e4213ba-4dea-434d-968d-437e7fb56516',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.182230] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.182337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.182513] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e4213ba-4dea-434d-968d-437e7fb56516 with status ACTIVE [ 987.182963] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.182963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.182963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.183160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.183160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.183332] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.183395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.183454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.183599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.183665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.183835] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.183920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.183974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.184115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.184180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.184266] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e4213ba-4dea-434d-968d-437e7fb56516 is going to be updated. [ 987.207078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.207247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.207247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.207398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.207534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.207690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e4213ba-4dea-434d-968d-437e7fb56516" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.546668] env[65992]: INFO networking_nsxv3.common.synchronization [None req-02f150d3-496b-4ffc-921e-5be2bdb5cbd2 tempest-ImagesOneServerNegativeTestJSON-1206007642 tempest-ImagesOneServerNegativeTestJSON-1206007642-project-member] Enqueued Resource ID: e71e807f-b402-44a5-b588-672a0d36bfce with Priority: HIGHEST for action security_group_rules [ 987.547782] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71e807f-b402-44a5-b588-672a0d36bfce with Priority: HIGHEST for action security_group_rules [ 987.548198] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e71e807f-b402-44a5-b588-672a0d36bfce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.548388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e71e807f-b402-44a5-b588-672a0d36bfce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.548454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e71e807f-b402-44a5-b588-672a0d36bfce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.548753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e71e807f-b402-44a5-b588-672a0d36bfce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.550063] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e71e807f-b402-44a5-b588-672a0d36bfce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.599634] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 987.600309] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a deletion is rescheduled due to dependency. [ 987.600309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.600309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.600309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.600719] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.600719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.600719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.600946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.601066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.601066] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.719752] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c85f1637-080d-4e17-b411-37611bc225f1 tempest-ImagesOneServerNegativeTestJSON-1206007642 tempest-ImagesOneServerNegativeTestJSON-1206007642-project-member] Enqueued Resource ID: e71e807f-b402-44a5-b588-672a0d36bfce with Priority: HIGHEST for action security_group_rules [ 987.720355] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71e807f-b402-44a5-b588-672a0d36bfce with Priority: HIGHEST for action security_group_rules [ 987.720655] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e71e807f-b402-44a5-b588-672a0d36bfce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.720958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e71e807f-b402-44a5-b588-672a0d36bfce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.738355] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 987.738574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.739078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.739317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.739522] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.739620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.739681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.739828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.739904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.739993] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.072921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.073086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.073158] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.073455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.073455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.073572] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e71e807f-b402-44a5-b588-672a0d36bfce already deleted. [ 988.073613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e71e807f-b402-44a5-b588-672a0d36bfce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.073794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e71e807f-b402-44a5-b588-672a0d36bfce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.073949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e71e807f-b402-44a5-b588-672a0d36bfce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.074041] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e71e807f-b402-44a5-b588-672a0d36bfce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.102807] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.242052] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.598276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.598496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.598541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.598831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.598888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.598990] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e71e807f-b402-44a5-b588-672a0d36bfce already deleted. [ 988.599112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e71e807f-b402-44a5-b588-672a0d36bfce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.605670] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.744737] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.109327] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.109597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.109597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.110168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.110168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.110168] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 989.149197] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.149719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.149719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.149864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.150749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.162305] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 989.248448] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.248963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.248963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.249133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.249206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.249364] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 989.305027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.305229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.305293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.305609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.305764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.317918] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 989.852758] env[65992]: INFO networking_nsxv3.common.synchronization [req-dddffc90-61aa-47ac-ac88-8c44c02599b5 req-d3e7cf41-1689-4c51-93f4-ed0cd46baa82 tempest-InstanceActionsNegativeTestJSON-994043228 tempest-InstanceActionsNegativeTestJSON-994043228-project-member] Enqueued Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGHEST for action security_group_members [ 989.854224] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGHEST for action security_group_members [ 989.854224] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.854224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.854224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.854224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.854542] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.854542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.854542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.854676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.854757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.854847] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.357717] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.357717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.357717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.357717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.357717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.357717] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.357717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.357717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.358152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.358152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.358152] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e is going to be updated. [ 990.386920] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.387104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.387172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.387412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.387558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.397701] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e in Status: IN_PROGRESS for 2s [ 991.173865] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 991.174253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.174299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.174498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.174699] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.174816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.174916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.175052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.175135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.175219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.175333] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.238228] env[65992]: INFO networking_nsxv3.common.synchronization [None req-890a47d4-76d8-49cd-8a3a-1a496909514c None None] Enqueued Resource ID: cb02b7a1-0322-4a89-91f7-67257719af7a with Priority: HIGHEST for action port [ 991.238910] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb02b7a1-0322-4a89-91f7-67257719af7a with Priority: HIGHEST for action port [ 991.241167] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb02b7a1-0322-4a89-91f7-67257719af7a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.241333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb02b7a1-0322-4a89-91f7-67257719af7a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.241435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb02b7a1-0322-4a89-91f7-67257719af7a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.241719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb02b7a1-0322-4a89-91f7-67257719af7a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.241818] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb02b7a1-0322-4a89-91f7-67257719af7a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.330140] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 991.331269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.331269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.331269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.331269] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.331269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.331269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.331678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.331678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.331678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.331900] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.331900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.331900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.332113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.333081] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.333081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.333081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.333081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.333081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.333326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.333326] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.653770] env[65992]: INFO networking_nsxv3.common.synchronization [req-c9efa7c3-37f9-4841-bfef-74de5cbc9c3f req-e65ed33e-cad3-439b-a0cf-00b530e328de tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 991.654533] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 991.655038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.655760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.655760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.655760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.655925] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.656044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.656136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.656341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.656483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.656606] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.677749] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.677963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.677963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.678261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.678440] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.678549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.678617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.678755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.678835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.678921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.679092] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.679179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.679280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.679494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.679705] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.679841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.679916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.680081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.680154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.680394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.680394] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.748726] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb02b7a1-0322-4a89-91f7-67257719af7a [ 991.748726] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.748726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.748726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.748726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.748726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.748726] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb02b7a1-0322-4a89-91f7-67257719af7a already deleted. [ 991.748726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb02b7a1-0322-4a89-91f7-67257719af7a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.838772] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fae6f001-d48c-45ec-8f59-9ecf82d77e91: rpc.has_security_group_logging(os_id): False [ 991.863038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.863259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.863259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.863609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.863762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.864109] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.864253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.864345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.864668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.864812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.865141] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.865234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.865284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.865432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.865513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.865779] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.865878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.865929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.866066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.866144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.866233] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 991.939021] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.939021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.939021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.939021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.939021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.958494] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 992.121027] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.121027] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.121027] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.121284] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.121420] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.121573] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.123684] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.123684] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.123684] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.123684] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.123684] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.123684] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.123684] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.123684] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.123684] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.123684] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.149312] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.149312] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.149312] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.149312] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-600" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.149312] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-1a4b48ca-5374-439f-87a1-c1efc0629079 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.149312] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-1a4b48ca-5374-439f-87a1-c1efc0629079" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.149312] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-1a4b48ca-5374-439f-87a1-c1efc0629079" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.149312] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-1a4b48ca-5374-439f-87a1-c1efc0629079" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.149312] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a4b48ca-5374-439f-87a1-c1efc0629079',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.159477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.159793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.159868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.160138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.160210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.160466] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.160647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.160742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.160943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.161105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.161105] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 992.183663] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 246ce419-a7b7-4e23-8bd8-c4c071ac447a: rpc.has_security_group_logging(os_id): False [ 992.198074] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.198282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.198282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.198497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.198683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.211048] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 992.212072] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.212219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.212311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.212504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.212625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.212855] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.212960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.213039] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.213201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.213274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.213494] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.213688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.213688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.213936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.213936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.214116] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.216196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.216196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.216196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.216196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.216196] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 992.354727] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.354931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.354931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.355293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.355474] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.382947] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 992.426312] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e in Status: SUCCESS [ 992.426581] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e deletion is rescheduled due to dependency. [ 992.426736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.652656] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.652945] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.653126] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.653409] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.653556] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.653708] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 1a4b48ca-5374-439f-87a1-c1efc0629079 not found, creating... [ 992.653974] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.654143] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.654261] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.655349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.655349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.655349] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.660072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.660072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.660072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.660072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.660072] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 1a4b48ca-5374-439f-87a1-c1efc0629079 is going to be created. [ 992.687544] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.687770] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.687890] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.688201] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.688436] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.688705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-1a4b48ca-5374-439f-87a1-c1efc0629079" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.178079] env[65992]: INFO networking_nsxv3.common.synchronization [None req-49994030-1216-4bf1-9811-00b22ecbe01c tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_rules [ 993.178707] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_rules [ 993.178980] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579076b3-83ee-4ba4-9a58-7938062d1f76 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.179429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.179429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.179726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.179919] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.334440] env[65992]: INFO networking_nsxv3.common.synchronization [None req-4e316e04-668a-4190-828a-c1cbc1340dac tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_rules [ 993.334954] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_rules [ 993.335265] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579076b3-83ee-4ba4-9a58-7938062d1f76 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.335361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.469370] env[65992]: INFO networking_nsxv3.common.synchronization [req-c9efa7c3-37f9-4841-bfef-74de5cbc9c3f req-e7202870-3a94-418c-8e25-22c6edf784da service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 993.469479] env[65992]: INFO networking_nsxv3.common.synchronization [req-c9efa7c3-37f9-4841-bfef-74de5cbc9c3f req-e7202870-3a94-418c-8e25-22c6edf784da service nova] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 993.469633] env[65992]: INFO networking_nsxv3.common.synchronization [req-c9efa7c3-37f9-4841-bfef-74de5cbc9c3f req-e7202870-3a94-418c-8e25-22c6edf784da service nova] Enqueued Resource ID: 1a4b48ca-5374-439f-87a1-c1efc0629079 with Priority: HIGHEST for action port [ 993.470405] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_rules [ 993.470529] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 993.471714] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a4b48ca-5374-439f-87a1-c1efc0629079 with Priority: HIGHEST for action port [ 993.471714] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.471714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.471714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.471714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.471714] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.473304] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.473304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.473304] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a4b48ca-5374-439f-87a1-c1efc0629079 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.473304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a4b48ca-5374-439f-87a1-c1efc0629079" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.473304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a4b48ca-5374-439f-87a1-c1efc0629079" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.473686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a4b48ca-5374-439f-87a1-c1efc0629079" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.473686] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a4b48ca-5374-439f-87a1-c1efc0629079',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.703744] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.703744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.703744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.703744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.703744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.703744] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 already deleted. [ 993.703744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.703744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.704085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.704085] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.976375] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 993.976636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.976985] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.977213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.977519] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a4b48ca-5374-439f-87a1-c1efc0629079 with status ACTIVE [ 993.977596] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.977726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.977805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.978055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.978164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.978508] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.978598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.978662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.978827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.978906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.979306] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.979375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.979408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.979685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.979685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.979745] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a4b48ca-5374-439f-87a1-c1efc0629079 is going to be updated. [ 993.981036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.981149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.982238] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.012754] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.012754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.012952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.013026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.013461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.013754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a4b48ca-5374-439f-87a1-c1efc0629079" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.092217] env[65992]: INFO networking_nsxv3.common.synchronization [None req-0b6d8a37-88f6-40c8-83a5-af86d3915f30 None None] Enqueued Resource ID: f25e8a53-60e9-4f19-8e0e-1676652d747b with Priority: HIGHEST for action port [ 994.092866] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f25e8a53-60e9-4f19-8e0e-1676652d747b with Priority: HIGHEST for action port [ 994.093284] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f25e8a53-60e9-4f19-8e0e-1676652d747b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.093453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f25e8a53-60e9-4f19-8e0e-1676652d747b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.093515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f25e8a53-60e9-4f19-8e0e-1676652d747b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.093792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f25e8a53-60e9-4f19-8e0e-1676652d747b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.093912] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f25e8a53-60e9-4f19-8e0e-1676652d747b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.224424] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 994.224424] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 994.224424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.224963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.225334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.225657] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.225959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.226725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.226725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.226725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.226725] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.233432] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.233564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.233622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.233821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.233889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.233983] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 already deleted. [ 994.234079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.397585] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 994.398862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.485827] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.486181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.486311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.487067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.487067] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.487274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.487274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.487615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.487615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.487715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.487846] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.597054] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f25e8a53-60e9-4f19-8e0e-1676652d747b [ 994.597491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.597708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.597708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.597929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.598082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.598160] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f25e8a53-60e9-4f19-8e0e-1676652d747b already deleted. [ 994.598246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f25e8a53-60e9-4f19-8e0e-1676652d747b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.729103] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.990710] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.990898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.990898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.991087] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.991271] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.991380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.991431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.991608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.991748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.991875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.992059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.992168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.992215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.992366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.992503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.992587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.992654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.992790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.992880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.992979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.993085] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.232950] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.326500] env[65992]: INFO networking_nsxv3.common.synchronization [req-eda7a0ef-292a-4ae2-bfbc-a931246ca7b1 req-b068e7db-de99-4083-8e4f-50f712355342 tempest-ServerRescueTestJSON-228920212 tempest-ServerRescueTestJSON-228920212-project-member] Enqueued Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 995.327948] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 995.328842] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.328842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.328842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.328842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.329097] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.329097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.329189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.329360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.329442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.329554] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.499731] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fae6f001-d48c-45ec-8f59-9ecf82d77e91: rpc.has_security_group_logging(os_id): False [ 995.518659] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.518811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.518918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.519296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.519452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.519733] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.519851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.519917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.520134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.520217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.520464] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.520597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.520677] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.520828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.520901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.521121] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.521217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.521287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.521421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.521511] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.521599] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 995.590923] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.591153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.591203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.591409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.591583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.627329] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 995.735357] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.735597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.735597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.735780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.735863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.735965] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 995.780279] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.780486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.780486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.780763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.780763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.794631] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 995.800817] env[65992]: INFO networking_nsxv3.common.synchronization [req-8d1f40c0-e290-40ed-8c54-3cb220a0e04f req-22fb22fb-d0b3-43dd-aa2e-baa7870fbcce tempest-MultipleCreateTestJSON-1501668855 tempest-MultipleCreateTestJSON-1501668855-project-member] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 995.800817] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 995.801100] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.801100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.801100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.801432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.801432] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.801576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.801576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.801731] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.801811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.801858] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.832794] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.905025] env[65992]: INFO networking_nsxv3.common.synchronization [req-c0251254-14df-4cf2-b6bc-d537fb4ec308 req-2d71819f-c088-4269-b5c1-b614c4998bfd tempest-MultipleCreateTestJSON-1501668855 tempest-MultipleCreateTestJSON-1501668855-project-member] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 995.905025] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGHEST for action security_group_members [ 995.905452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.905708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.304842] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.334510] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.807355] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.838055] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.838055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.838055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.838055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.838055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.838055] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 is going to be updated. [ 996.878160] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.878304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.878439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.878815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.878815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.889546] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: IN_PROGRESS for 2s [ 997.309384] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.309637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.309889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.309972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.310163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.310318] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 997.350971] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.351243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.351360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.351758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.352075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.365426] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 997.643507] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 997.644134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.806306] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 997.806306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.806306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.806306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.806306] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.806306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.806306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.806306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.806306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.806306] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.806306] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.154677] env[65992]: INFO networking_nsxv3.common.synchronization [req-919c2008-c936-4a8b-94bf-5af33d2fdba2 req-aa455244-4eaa-4163-a13e-631a34c16abe tempest-ServerActionsTestOtherB-918399856 tempest-ServerActionsTestOtherB-918399856-project-member] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 998.155264] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 998.156031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.156031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.156031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.156031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.156286] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.156422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.156529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.156705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.156793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.156888] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.310703] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.313453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.313453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.313760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.313949] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.314070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.314135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.314294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.314374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.314461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.314618] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.314714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.314817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.314910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.315052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.315143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.315207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.315339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.315412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.315497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.315586] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.556253] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.556445] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.556570] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.556938] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.557252] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.557436] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.557522] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.557743] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.557896] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.558125] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.558240] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.558349] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.558462] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.558575] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.558678] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.558810] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.577692] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.577884] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 998.578042] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.578209] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.578524] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.578700] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.578816] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.579164] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.579375] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b4d4fa-b1dd-407e-8dc5-27e0a39c882a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.659204] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.659408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.659483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.659715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.659804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.659995] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.660208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.660208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.660311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.660425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.660492] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c already deleted. [ 998.660549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.821350] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6866765e-0cdc-4d35-aa21-1b0f99339ef0: rpc.has_security_group_logging(os_id): False [ 998.844439] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.844640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.844687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.845098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.845098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.845221] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.845309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.845371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.845571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.845702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.845922] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.846147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.846292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.847012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.847012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.847012] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.847012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.847012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.847326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.847326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.847326] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 998.898531] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: SUCCESS [ 998.898796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.909688] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.909821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.909918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.910162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.910334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.931402] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 999.032612] env[65992]: INFO networking_nsxv3.common.synchronization [None req-126f3394-a6f2-49a8-8928-5288696a3cad tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_rules [ 999.033159] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_rules [ 999.033476] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa4dd424-5723-4237-8888-a19ff8313111 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.033601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.033666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.033929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.034022] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.081519] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.081930] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.082110] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.082419] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.082580] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.082743] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 23b4d4fa-b1dd-407e-8dc5-27e0a39c882a not found, creating... [ 999.083081] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.083262] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.083388] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.083643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.083805] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.084097] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.084414] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.084414] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.084835] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.084976] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.085130] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 23b4d4fa-b1dd-407e-8dc5-27e0a39c882a is going to be created. [ 999.133633] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.133864] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.133990] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.134305] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.134535] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.134769] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.139511] env[65992]: INFO networking_nsxv3.common.synchronization [None req-2651be8e-2bf6-4fe5-b9ab-7d12c4afb383 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_rules [ 999.140387] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_rules [ 999.140447] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa4dd424-5723-4237-8888-a19ff8313111 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.140516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.377179] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 999.377715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.377715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.378395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.378395] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.378639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.378684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.378872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.378986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.379111] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.555689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.555877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.556171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.556310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.556310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.556424] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa4dd424-5723-4237-8888-a19ff8313111 already deleted. [ 999.556581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.556680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.556877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.556962] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.881928] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.882100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.882168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.882379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.882475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.882675] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.882771] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.882847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.883015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.883099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.883184] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be updated. [ 999.912508] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.912508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.912508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.912930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.912930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.924448] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: IN_PROGRESS for 2s [ 1000.080989] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.081186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.081256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.081463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.081555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.081705] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa4dd424-5723-4237-8888-a19ff8313111 already deleted. [ 1000.081842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.272589] env[65992]: INFO networking_nsxv3.common.synchronization [req-919c2008-c936-4a8b-94bf-5af33d2fdba2 req-047d6f28-19ba-4f14-8b7b-c750a4ecc648 service nova] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 1000.272740] env[65992]: INFO networking_nsxv3.common.synchronization [req-919c2008-c936-4a8b-94bf-5af33d2fdba2 req-047d6f28-19ba-4f14-8b7b-c750a4ecc648 service nova] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1000.272877] env[65992]: INFO networking_nsxv3.common.synchronization [req-919c2008-c936-4a8b-94bf-5af33d2fdba2 req-047d6f28-19ba-4f14-8b7b-c750a4ecc648 service nova] Enqueued Resource ID: 23b4d4fa-b1dd-407e-8dc5-27e0a39c882a with Priority: HIGHEST for action port [ 1000.273439] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 1000.273581] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1000.273680] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b4d4fa-b1dd-407e-8dc5-27e0a39c882a with Priority: HIGHEST for action port [ 1000.274072] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.274132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.274177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.274427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.274462] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.275316] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.275433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.275509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.276396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.276396] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.276396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.276396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.276396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.276396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.276396] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.277620] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.277620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.277620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.277620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.277620] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b4d4fa-b1dd-407e-8dc5-27e0a39c882a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.710607] env[65992]: INFO networking_nsxv3.common.synchronization [req-8938319a-3afa-4c58-a5eb-658040b27f59 req-4f0fdd7e-78b2-430e-9330-519ddc53189c tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1000.711482] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1000.711482] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.711482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.711691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.711866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.712300] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.712451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.713263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.713263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.713263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.713263] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.780009] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.780009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.780009] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.781688] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23b4d4fa-b1dd-407e-8dc5-27e0a39c882a with status ACTIVE [ 1000.781688] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.781688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.781688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.781688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.781688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.783305] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.783416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.783485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.783657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.783731] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.783913] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.784019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.784095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.784217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.784289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.784374] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23b4d4fa-b1dd-407e-8dc5-27e0a39c882a is going to be updated. [ 1000.805147] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.805698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.805795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.805975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.806121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.806278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23b4d4fa-b1dd-407e-8dc5-27e0a39c882a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.954473] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 1000.954739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.095967] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.098029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.098029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.098029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.098029] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.098029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.098029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.098029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.098029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.098692] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.098974] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.099264] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.099589] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.100696] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.100696] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.100696] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.148188] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.148607] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1001.148818] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.149086] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.149671] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-acfcca5d-f26b-4296-95c6-558cd3e56545 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.149924] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-acfcca5d-f26b-4296-95c6-558cd3e56545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.150110] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-acfcca5d-f26b-4296-95c6-558cd3e56545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.150539] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-acfcca5d-f26b-4296-95c6-558cd3e56545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.150687] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acfcca5d-f26b-4296-95c6-558cd3e56545',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.216323] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.281458] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.653719] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.653981] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.654148] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.654404] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.654571] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.654724] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port acfcca5d-f26b-4296-95c6-558cd3e56545 not found, creating... [ 1001.654998] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.655181] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.655321] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.655547] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.656079] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.656079] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.656214] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.656214] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.656412] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.656539] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.656671] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: acfcca5d-f26b-4296-95c6-558cd3e56545 is going to be created. [ 1001.678648] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.678648] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.678648] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.678957] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.679824] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.679824] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-acfcca5d-f26b-4296-95c6-558cd3e56545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.719123] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.785218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.785417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.785491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.785666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.785748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.785849] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be created. [ 1001.832161] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.832320] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.832392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.832603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.832766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.842942] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: UNINITIALIZED for 2s [ 1001.936720] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 in Status: SUCCESS [ 1001.936897] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 deletion is rescheduled due to dependency. [ 1001.937015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.225364] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.225551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.225620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.225876] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.225993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.226127] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1002.262142] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.262142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.262142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.262142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.262142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.280520] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1002.419974] env[65992]: INFO networking_nsxv3.common.synchronization [req-8938319a-3afa-4c58-a5eb-658040b27f59 req-50180315-9954-4ca5-af5c-285f7237fb8b service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 1002.420180] env[65992]: INFO networking_nsxv3.common.synchronization [req-8938319a-3afa-4c58-a5eb-658040b27f59 req-50180315-9954-4ca5-af5c-285f7237fb8b service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1002.420468] env[65992]: INFO networking_nsxv3.common.synchronization [req-8938319a-3afa-4c58-a5eb-658040b27f59 req-50180315-9954-4ca5-af5c-285f7237fb8b service nova] Enqueued Resource ID: acfcca5d-f26b-4296-95c6-558cd3e56545 with Priority: HIGHEST for action port [ 1002.422060] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 1002.422722] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1002.423651] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acfcca5d-f26b-4296-95c6-558cd3e56545 with Priority: HIGHEST for action port [ 1002.424230] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.424327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.424446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.425124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.425124] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.427071] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.427238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.427913] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-acfcca5d-f26b-4296-95c6-558cd3e56545 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.428099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acfcca5d-f26b-4296-95c6-558cd3e56545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.428210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acfcca5d-f26b-4296-95c6-558cd3e56545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.429923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acfcca5d-f26b-4296-95c6-558cd3e56545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.429923] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acfcca5d-f26b-4296-95c6-558cd3e56545',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.931333] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.931705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.931705] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acfcca5d-f26b-4296-95c6-558cd3e56545 with status ACTIVE [ 1002.931892] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.932016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.932089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.932299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.932444] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.932553] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.932654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.932716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.932884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.932996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.933409] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.933537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.933719] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.933926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.934304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.934443] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acfcca5d-f26b-4296-95c6-558cd3e56545 is going to be updated. [ 1002.958647] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.958816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.958863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.959083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.959217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.959578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acfcca5d-f26b-4296-95c6-558cd3e56545" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.594077] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c70639a4-b62c-41e6-8324-952daf10f312 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: d16b9f26-47a5-4aee-9334-86ee53f7c27c with Priority: HIGHEST for action security_group_rules [ 1003.596873] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16b9f26-47a5-4aee-9334-86ee53f7c27c with Priority: HIGHEST for action security_group_rules [ 1003.596873] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.596873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.597166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.597351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.597521] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d16b9f26-47a5-4aee-9334-86ee53f7c27c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.706238] env[65992]: INFO networking_nsxv3.common.synchronization [None req-a5b64859-b6f8-48bd-b3e8-ee35b0ac7f90 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: d16b9f26-47a5-4aee-9334-86ee53f7c27c with Priority: HIGHEST for action security_group_rules [ 1003.706833] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16b9f26-47a5-4aee-9334-86ee53f7c27c with Priority: HIGHEST for action security_group_rules [ 1003.709055] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.709828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.854469] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1003.854839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.854839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.855061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.855263] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.855462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.855545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.855707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.855786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.855871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.855957] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.123636] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.124030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.124030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.124274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.124274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.124274] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d16b9f26-47a5-4aee-9334-86ee53f7c27c already deleted. [ 1004.124461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.124495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.124655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.124737] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d16b9f26-47a5-4aee-9334-86ee53f7c27c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.294897] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1004.295889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.295889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.296147] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.296213] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.296349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.296499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.296574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.296688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.296764] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.358563] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.646578] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.646578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.646578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.646578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.646896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.646896] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d16b9f26-47a5-4aee-9334-86ee53f7c27c already deleted. [ 1004.646965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d16b9f26-47a5-4aee-9334-86ee53f7c27c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.798773] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.862346] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c: rpc.has_security_group_logging(os_id): False [ 1004.880935] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.881097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.881167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.881405] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.881545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.881836] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.881943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.882049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.882275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.882402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.882541] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be created. [ 1004.949136] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.949343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.949427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.949722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.949971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.965828] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1005.302050] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.667228] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8730490-2794-4be9-be4c-18bc8827a61f req-bbc2f973-4c18-4fbe-b5c2-80beb7a43ff4 tempest-ImagesOneServerNegativeTestJSON-1206007642 tempest-ImagesOneServerNegativeTestJSON-1206007642-project-member] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1005.668367] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1005.670028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.670028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.670028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.670028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.670028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.670028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.670028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.670028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.670028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.670028] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.803881] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.804043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.804174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.804442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.804558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.804682] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1005.839634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.839634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.839634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.839634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.839634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.850585] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1006.036709] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-843 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.036913] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.037179] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.037555] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.037976] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.038218] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.038460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.038751] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.039226] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.039571] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.039714] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.039850] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.039983] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.040135] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.040271] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.040441] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.060360] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.060754] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.060863] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.061052] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.061381] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-8a12d998-82cf-4507-94a9-3b9cd9d95504 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.061594] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-8a12d998-82cf-4507-94a9-3b9cd9d95504" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.061715] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-8a12d998-82cf-4507-94a9-3b9cd9d95504" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.062059] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-8a12d998-82cf-4507-94a9-3b9cd9d95504" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.062197] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a12d998-82cf-4507-94a9-3b9cd9d95504',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.172104] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.172339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.172417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.172635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.172727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.172931] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.173034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.173117] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.173241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.173323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.173409] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1006.203163] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.203163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.203163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.203163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.203163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.215893] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 1006.564926] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.565335] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.565498] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.565955] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.566191] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.566426] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 8a12d998-82cf-4507-94a9-3b9cd9d95504 not found, creating... [ 1006.566822] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.567151] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.567261] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.567602] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.567800] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.568799] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.569216] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.569385] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.571028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.571372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.571682] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 8a12d998-82cf-4507-94a9-3b9cd9d95504 is going to be created. [ 1006.602105] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.602342] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.602466] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.602789] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.603060] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.603307] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-8a12d998-82cf-4507-94a9-3b9cd9d95504" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.986782] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1006.987188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.129109] env[65992]: INFO networking_nsxv3.common.synchronization [req-2d57ff48-d118-4c28-ae16-938715c1d82f req-98fab0ae-ce0f-419b-900b-6df3b2b451d5 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1007.129109] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1007.129777] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.129777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.129777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.129777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.130028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.130028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.130028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.130301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.130475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.130559] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.303300] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1007.303435] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1007.399607] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8730490-2794-4be9-be4c-18bc8827a61f req-8095639e-12b2-4031-bdf3-be6a1e95e59a service nova] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_rules [ 1007.399938] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8730490-2794-4be9-be4c-18bc8827a61f req-8095639e-12b2-4031-bdf3-be6a1e95e59a service nova] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1007.400099] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8730490-2794-4be9-be4c-18bc8827a61f req-8095639e-12b2-4031-bdf3-be6a1e95e59a service nova] Enqueued Resource ID: 8a12d998-82cf-4507-94a9-3b9cd9d95504 with Priority: HIGHEST for action port [ 1007.400891] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_rules [ 1007.401309] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1007.401309] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a12d998-82cf-4507-94a9-3b9cd9d95504 with Priority: HIGHEST for action port [ 1007.401487] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.402066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.402066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.402066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.402066] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.403171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.403171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.403171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a12d998-82cf-4507-94a9-3b9cd9d95504 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.403333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a12d998-82cf-4507-94a9-3b9cd9d95504" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.403333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a12d998-82cf-4507-94a9-3b9cd9d95504" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.403713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a12d998-82cf-4507-94a9-3b9cd9d95504" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.403713] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a12d998-82cf-4507-94a9-3b9cd9d95504',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.633304] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.633768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.633768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.633768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.633904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.634045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.634146] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.634257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.634467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.634467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.634542] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1007.664420] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.664604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.664648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.664845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.665010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.678577] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1007.862851] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1007.863304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.863605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.863848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.864072] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.864200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.864265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.864432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.864517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.864599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.864693] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.906056] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.906214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.908680] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a12d998-82cf-4507-94a9-3b9cd9d95504 with status ACTIVE [ 1007.908953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.909044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.909120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.909529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.909622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.909881] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.909989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.910067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.910233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.910330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.910633] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.910791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.910884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.911101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.911197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.911283] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a12d998-82cf-4507-94a9-3b9cd9d95504 is going to be updated. [ 1007.937573] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.937775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.937775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.937989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.938170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.938337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a12d998-82cf-4507-94a9-3b9cd9d95504" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.225411] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1008.227751] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 deletion is rescheduled due to dependency. [ 1008.227751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.227751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.227751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.227751] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.227751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.227751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.227751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.227751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.227751] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.316405] env[65992]: INFO networking_nsxv3.common.synchronization [req-67cbd667-1547-48ba-b43a-cf165efa7352 req-b2f2e2bb-b2ae-47cf-b67e-3b70714b158d tempest-ImagesTestJSON-683267755 tempest-ImagesTestJSON-683267755-project-member] Enqueued Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 1008.317193] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a with Priority: HIGHEST for action security_group_members [ 1008.317193] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-246ce419-a7b7-4e23-8bd8-c4c071ac447a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.317418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.317418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.317648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.317815] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.317912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.317990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.318163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.318261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.318479] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246ce419-a7b7-4e23-8bd8-c4c071ac447a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.369909] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.369909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.369909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.369909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.369909] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.369909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.369909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.369909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.369909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.369909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.370585] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.370585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.370585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.370585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.370777] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.371782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.371782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.371782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.371782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.371782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.371782] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.731917] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.821421] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.821421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.821421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.821649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.821649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.821805] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.821951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.822067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.822235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.822342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.822495] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a is going to be updated. [ 1008.856797] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.856925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.856995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.857240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.857409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.867372] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: IN_PROGRESS for 2s [ 1008.874390] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6417014f-241b-4b36-8b7b-aeef9e200013: rpc.has_security_group_logging(os_id): False [ 1008.900564] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.900695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.900734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.901100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.901100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.901246] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.901653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.901653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.901653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.901653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.901854] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.902017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.902017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.902256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.902256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.902448] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.903078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.903078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.903078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.903078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.903078] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1008.964995] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.965180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.965244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.965454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.965873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.980982] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1009.234183] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.690132] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1009.690461] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 1009.690606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.738333] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.738333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.738333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.738333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.738333] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.738333] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1009.776213] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.776397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.776554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.777056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.777263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.787790] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 1010.297975] env[65992]: INFO networking_nsxv3.common.synchronization [req-17f2f0c4-dcff-46ce-baab-145cf9821a22 req-484b08e2-fa6c-4bea-abc2-4bb263df2e03 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_members [ 1010.298424] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_members [ 1010.298767] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-579076b3-83ee-4ba4-9a58-7938062d1f76 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.298896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.298969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.299240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.299571] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.299706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.299821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.300048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.300159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.300241] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.696855] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.697068] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.697189] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.697524] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.699248] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.699248] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.699248] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.699248] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.699248] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.699248] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.699248] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.699248] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.699248] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.699248] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1010.699783] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.699845] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.726471] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.726471] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1010.726471] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.726471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.726471] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.726471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.726471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.726863] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.727405] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d0dbcc3-0dcc-49dc-8f80-6a684edee126',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.803997] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.804453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.804453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.804601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.804810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.805117] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.805289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.805402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.805665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.805806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.805946] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 already deleted. [ 1010.806091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.880603] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a in Status: SUCCESS [ 1010.880603] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246ce419-a7b7-4e23-8bd8-c4c071ac447a deletion is rescheduled due to dependency. [ 1010.880603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246ce419-a7b7-4e23-8bd8-c4c071ac447a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.007098] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1011.007380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.232078] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.232078] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.232078] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.232078] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.232078] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.232351] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 0d0dbcc3-0dcc-49dc-8f80-6a684edee126 not found, creating... [ 1011.232447] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.232723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.232861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.233099] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.233241] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.233526] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.233685] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.233800] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.234013] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.234148] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.234286] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 0d0dbcc3-0dcc-49dc-8f80-6a684edee126 is going to be created. [ 1011.257563] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.257789] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.258106] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.258242] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.258545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.258705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.800513] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1011.800513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.800513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.800860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.800921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.801043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.801043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.801716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.801716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.801716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.801716] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.011200] env[65992]: INFO networking_nsxv3.common.synchronization [req-17f2f0c4-dcff-46ce-baab-145cf9821a22 req-ab135962-5cf1-4d9e-b7f0-3d26c347be99 service nova] Enqueued Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_rules [ 1012.011200] env[65992]: INFO networking_nsxv3.common.synchronization [req-17f2f0c4-dcff-46ce-baab-145cf9821a22 req-ab135962-5cf1-4d9e-b7f0-3d26c347be99 service nova] Enqueued Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_members [ 1012.011200] env[65992]: INFO networking_nsxv3.common.synchronization [req-17f2f0c4-dcff-46ce-baab-145cf9821a22 req-ab135962-5cf1-4d9e-b7f0-3d26c347be99 service nova] Enqueued Resource ID: 0d0dbcc3-0dcc-49dc-8f80-6a684edee126 with Priority: HIGHEST for action port [ 1012.011200] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_rules [ 1012.015742] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_members [ 1012.015942] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0dbcc3-0dcc-49dc-8f80-6a684edee126 with Priority: HIGHEST for action port [ 1012.016328] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579076b3-83ee-4ba4-9a58-7938062d1f76 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.016477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.016579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.016831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.016914] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.018205] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-579076b3-83ee-4ba4-9a58-7938062d1f76 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.019452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.019452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.019452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.019452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.019452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.019452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.030024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.030024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.030024] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.030024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.030024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.030024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.030024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.030024] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d0dbcc3-0dcc-49dc-8f80-6a684edee126',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.307627] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.307835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.308051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.308278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.308473] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.308646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.308646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.308797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.308885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.309014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.309140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.309238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.309299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.309540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.309684] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.309819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.309819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.309963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.310049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.310135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.310231] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.531167] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-579076b3-83ee-4ba4-9a58-7938062d1f76 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.531330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.532783] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.533821] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d0dbcc3-0dcc-49dc-8f80-6a684edee126 with status ACTIVE [ 1012.534126] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.534277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.534341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.534653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.534731] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.534865] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.534962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.535044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.535216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.535294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.535507] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.535642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.535723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.535877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.535952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.536059] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d0dbcc3-0dcc-49dc-8f80-6a684edee126 is going to be updated. [ 1012.559595] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.559779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.559851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.560093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.560243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.560406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d0dbcc3-0dcc-49dc-8f80-6a684edee126" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.813109] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e720f82-4c36-4848-b271-696bfa23a791: rpc.has_security_group_logging(os_id): False [ 1012.837505] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.837735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.837735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.837978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.838076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.838279] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.838377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.838430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.838588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.838666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.838851] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.838940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.839009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.839159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.839232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.839478] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.839577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.839673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.839798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.839871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.839956] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1012.938475] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.938667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.938667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.938976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.939178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.956451] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 1013.038623] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.541615] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.541831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.541913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.542233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.542285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.542344] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 is going to be created. [ 1013.567768] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.568788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.568788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.568788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.568788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.583707] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 in Status: UNINITIALIZED for 2s [ 1014.131851] env[65992]: INFO networking_nsxv3.common.synchronization [req-75976b90-c8ac-44e7-ad32-1d36fff56c8f req-682e3705-702d-4942-94c9-028c2f2c0887 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1014.132519] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1014.132980] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.133189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.133189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.133594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.133711] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.134047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.134047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.134182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.134182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.134257] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.637707] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.662638] env[65992]: INFO networking_nsxv3.common.synchronization [req-16fd29b7-32c2-4ae0-b462-cb3b07dfbca5 req-3ea21c64-9728-4047-99df-56c5ec6ed48f tempest-ServerRescueTestJSON-228920212 tempest-ServerRescueTestJSON-228920212-project-member] Enqueued Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 1014.663213] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 with Priority: HIGHEST for action security_group_members [ 1014.663572] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc75e044-2bf1-4d6d-8a88-0619925a4394 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.663689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.663769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.664011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.664551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.664689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.664751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.664942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.665063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.665164] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc75e044-2bf1-4d6d-8a88-0619925a4394',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.971830] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1014.972114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.139919] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.167294] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.167491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.167546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.167766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.167894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.168129] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.168234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.168296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.168458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.168534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.168618] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 is going to be updated. [ 1015.198370] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.199275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.199275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.199275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.199275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.208359] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: IN_PROGRESS for 2s [ 1015.593779] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 in Status: SUCCESS [ 1015.593985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.594186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.594794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.594794] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.594794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.594986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.594986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.595151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.595151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.595266] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.642025] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.642160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.642160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.642368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.642455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.642556] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1015.672929] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.673177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.673177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.673411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.673590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.683703] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1016.101370] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.607807] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 579076b3-83ee-4ba4-9a58-7938062d1f76: rpc.has_security_group_logging(os_id): False [ 1016.628034] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.628034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.628034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.628034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.628034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.628034] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.628034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.628034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.628034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.628034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.628034] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 is going to be created. [ 1016.686050] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.686196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.686257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.686457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.686659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.698251] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 in Status: IN_PROGRESS for 2s [ 1017.220353] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 in Status: SUCCESS [ 1017.220549] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc75e044-2bf1-4d6d-8a88-0619925a4394 deletion is rescheduled due to dependency. [ 1017.220632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc75e044-2bf1-4d6d-8a88-0619925a4394" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.695069] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1017.695397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.711382] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 in Status: SUCCESS [ 1018.711687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.771299] env[65992]: INFO networking_nsxv3.common.synchronization [req-11084e14-616e-45d4-ae6c-b4896682f2d0 req-22a0fe7e-c820-4c40-ba11-e038f5030525 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_members [ 1018.772048] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_members [ 1018.772185] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4dd424-5723-4237-8888-a19ff8313111 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.772301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.772363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.772618] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.772982] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.772982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.772982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.773305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.773393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.773524] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.117815] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.118376] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.118376] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.118675] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.119049] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.120073] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.120073] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.120073] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.120073] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.120273] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.120309] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.120468] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.120617] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.120757] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.120902] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.121093] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.142819] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.145017] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1019.145017] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.145017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.145017] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-f50fa3c4-b1ad-4d11-89c3-77754787142e taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.145017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-f50fa3c4-b1ad-4d11-89c3-77754787142e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.145017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-f50fa3c4-b1ad-4d11-89c3-77754787142e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.145017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-f50fa3c4-b1ad-4d11-89c3-77754787142e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.145017] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f50fa3c4-b1ad-4d11-89c3-77754787142e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.276980] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.277175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.277241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.277441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.277538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.277729] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.277832] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.277891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.278059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.278136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.278221] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa4dd424-5723-4237-8888-a19ff8313111 already deleted. [ 1019.278297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.648065] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.648065] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.648361] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.648472] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.648623] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.648776] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port f50fa3c4-b1ad-4d11-89c3-77754787142e not found, creating... [ 1019.649048] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.649208] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.649322] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.649567] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.649705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.649986] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.650155] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.650267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.650478] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.650602] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.650753] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: f50fa3c4-b1ad-4d11-89c3-77754787142e is going to be created. [ 1019.674188] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.674495] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.674716] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.674997] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.675261] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.675493] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-f50fa3c4-b1ad-4d11-89c3-77754787142e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.405026] env[65992]: INFO networking_nsxv3.common.synchronization [req-11084e14-616e-45d4-ae6c-b4896682f2d0 req-6058daf1-b888-40f6-8cd5-8c1cc5fce532 service nova] Enqueued Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_rules [ 1020.405368] env[65992]: INFO networking_nsxv3.common.synchronization [req-11084e14-616e-45d4-ae6c-b4896682f2d0 req-6058daf1-b888-40f6-8cd5-8c1cc5fce532 service nova] Enqueued Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_members [ 1020.405368] env[65992]: INFO networking_nsxv3.common.synchronization [req-11084e14-616e-45d4-ae6c-b4896682f2d0 req-6058daf1-b888-40f6-8cd5-8c1cc5fce532 service nova] Enqueued Resource ID: f50fa3c4-b1ad-4d11-89c3-77754787142e with Priority: HIGHEST for action port [ 1020.405817] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_rules [ 1020.407023] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_members [ 1020.407023] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f50fa3c4-b1ad-4d11-89c3-77754787142e with Priority: HIGHEST for action port [ 1020.407023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa4dd424-5723-4237-8888-a19ff8313111 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.407023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.407023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.407023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.407023] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.407777] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4dd424-5723-4237-8888-a19ff8313111 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.408549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.408753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.408983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.409157] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.409373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.409435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.409664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.409748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.409836] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.412029] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f50fa3c4-b1ad-4d11-89c3-77754787142e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.412214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f50fa3c4-b1ad-4d11-89c3-77754787142e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.412267] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f50fa3c4-b1ad-4d11-89c3-77754787142e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.412439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f50fa3c4-b1ad-4d11-89c3-77754787142e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.412539] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f50fa3c4-b1ad-4d11-89c3-77754787142e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.912299] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.913854] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4dd424-5723-4237-8888-a19ff8313111 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.913977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.914143] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f50fa3c4-b1ad-4d11-89c3-77754787142e with status ACTIVE [ 1020.914305] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.914411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.914470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.914683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.914767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.915031] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.915203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.915271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.915552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.915645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.915890] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.916026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.916026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.916162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.916275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.916321] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f50fa3c4-b1ad-4d11-89c3-77754787142e is going to be updated. [ 1020.946310] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.946457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.946526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.946730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.946861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.947030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f50fa3c4-b1ad-4d11-89c3-77754787142e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.415202] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.918160] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.918441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.918560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.918760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.918857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.918952] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa4dd424-5723-4237-8888-a19ff8313111 is going to be created. [ 1021.946496] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.946734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.946734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.946918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.947105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.958291] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa4dd424-5723-4237-8888-a19ff8313111 in Status: UNINITIALIZED for 2s [ 1022.253378] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.253613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.253720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.254014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.254179] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.756581] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.260432] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.629203] env[65992]: INFO networking_nsxv3.common.synchronization [req-2152253e-0b82-445e-9afe-85a5643da12c req-41263895-70dc-481a-a012-78c7290a24ef tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1023.629805] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1023.630255] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.630407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.630456] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.630683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.630978] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.630978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.631114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.631151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.631240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.631329] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.761584] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1023.762058] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1023.959925] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.960622] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.960622] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.960748] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.961277] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.961395] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.961538] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.962155] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.962308] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.962520] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.962630] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.962737] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.962840] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.962948] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.963061] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.963190] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.979504] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa4dd424-5723-4237-8888-a19ff8313111 in Status: SUCCESS [ 1023.979796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.979964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.980192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.980394] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.980556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.980629] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.980796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.980877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.980961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.981062] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.986347] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.986512] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.986647] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.986809] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.987211] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-37980b2b-25be-4189-85ee-b607ae463276 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.987367] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-37980b2b-25be-4189-85ee-b607ae463276" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.987486] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-37980b2b-25be-4189-85ee-b607ae463276" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.987778] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-37980b2b-25be-4189-85ee-b607ae463276" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.987919] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37980b2b-25be-4189-85ee-b607ae463276',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.134266] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.134480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.134480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.134667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.134892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.135133] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.135237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.135300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.135470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.135549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.135635] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1024.163296] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.163599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.163599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.163743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.163827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.174036] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1024.484281] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.494103] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.494103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.494103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.494103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.494103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.494103] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 37980b2b-25be-4189-85ee-b607ae463276 not found, creating... [ 1024.494103] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.494103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.494103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.494103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.494103] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.494899] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.494899] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.494899] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.498419] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.498419] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.498419] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 37980b2b-25be-4189-85ee-b607ae463276 is going to be created. [ 1024.525714] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.525714] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.525714] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.525714] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.525714] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.525714] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-37980b2b-25be-4189-85ee-b607ae463276" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.718120] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.718120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.719015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.719756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.731181] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1024.732050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.733273] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1024.769095] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.769370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.769370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.769496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.782181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.783748] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1024.783748] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1024.783748] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1024.830275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.830390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.830464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.830706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.832839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.833157] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1024.930020] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.930245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.930245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.930576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.930894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.931210] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1024.986178] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa4dd424-5723-4237-8888-a19ff8313111: rpc.has_security_group_logging(os_id): False [ 1025.007197] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.007347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.007468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.007814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.007919] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.008224] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.008340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.008407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.008582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.008679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.008787] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa4dd424-5723-4237-8888-a19ff8313111 is going to be created. [ 1025.023849] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.024098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.024098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.024302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.024595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.025326] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1025.025326] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8e720f82-4c36-4848-b271-696bfa23a791', '2fe1c430-86c0-4a40-8a1c-596f267de734', '4017384d-1105-4cfb-b204-60d05dcc6f67', '58a9088b-471e-48ab-8bf1-877d11c93872', '01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c', 'bb22631e-4990-471c-96cc-e4e5b0939818', '5b1651ec-9ca7-4bf6-866b-28fade5b94c5', '58879f8e-8e07-40c8-a0c9-63ab056f38ce', 'e35d0a29-9466-4e93-850f-29921a743936', '724ff346-b8e9-4eb5-b30d-7bfeb697d754', '6866765e-0cdc-4d35-aa21-1b0f99339ef0', '12a7f9db-1203-43be-8fe2-0b76907a767d', '010c8cc5-bfff-46eb-9de7-49acf403b856', '09fa0638-1a13-4fbd-a918-e188dff752a0', 'fdc7601c-fb13-4bed-8af5-454bff4da6cf', '8dbe3c7f-5b13-4659-b2e7-18c87792b278', '9344356d-cfd9-4f69-96db-d4a162e98dce', 'fe7e4325-0a58-45b0-b4d0-e088a125232f', 'fae6f001-d48c-45ec-8f59-9ecf82d77e91', '7b258045-d8dd-4354-9ab0-f5fa8a21ca0e', '6417014f-241b-4b36-8b7b-aeef9e200013', '0d26e35f-7f74-471f-aa86-2ea84a3690b8', '85011876-1ce8-49d5-9b25-2c9588597a4a', '7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8', 'ac3fb6b8-5af1-492f-992f-9183de28faa7', '8abc7e6f-b99b-4856-9c2c-59b9b0971df3', '308a2531-7733-489b-8a70-8bf49437f735', '246ce419-a7b7-4e23-8bd8-c4c071ac447a', 'dc75e044-2bf1-4d6d-8a88-0619925a4394', '06f48e26-5b6b-4a62-b58e-5e3abec6c0c9', 'ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23', '7883ea2f-8e33-46ff-9d56-25973809f24b', 'b9ae5db7-375e-4a37-a1a9-1b791ce8df64', 'f8f9dacc-af29-4b40-93c8-17d4f636d125', 'f7f9886e-09d8-4717-8a0d-1c46fb28d7ff', '99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7', '436e4ee0-1cae-4512-b766-d84853476f90', '8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6', '92df56c0-4890-4336-9656-3c0ad1e3b068', '4fca3990-1a47-43bc-b0dc-d0194335893d', 'b14e2cad-daae-4705-9dc6-6e9de8cef89f', 'aa8c9176-c0d4-4732-93ba-a80e6182488b', '579076b3-83ee-4ba4-9a58-7938062d1f76', '34a7c14c-af0d-4c42-abda-f1b7e2eebf3c', '4f8fddf5-e496-4959-a3e0-b872a3fbc0e7', '94744e32-5aaa-4c96-a135-74003f101fb3', 'aafaab8c-0f8b-4ded-b666-286994920d39'} {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1025.025326] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1025.048140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.048360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.048434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.048738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.048850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.049047] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1025.049130] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1025.049203] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1025.099844] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.100055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.100055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.100337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.101819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.121627] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa4dd424-5723-4237-8888-a19ff8313111 in Status: IN_PROGRESS for 2s [ 1025.166990] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.167164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.167235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.167451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.168480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.168836] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1025.168957] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1025.169077] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1025.169186] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1025.169299] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1025.169402] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGH for action security_group_rules [ 1025.169554] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGH for action security_group_rules [ 1025.169658] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGH for action security_group_rules [ 1025.169779] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGH for action security_group_rules [ 1025.169883] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGH for action security_group_rules [ 1025.169996] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGH for action security_group_rules [ 1025.170134] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGH for action security_group_rules [ 1025.170237] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGH for action security_group_rules [ 1025.170328] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGH for action security_group_rules [ 1025.170415] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGH for action security_group_rules [ 1025.170501] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGH for action security_group_rules [ 1025.170589] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGH for action security_group_rules [ 1025.170677] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGH for action security_group_rules [ 1025.170762] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGH for action security_group_rules [ 1025.170852] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGH for action security_group_rules [ 1025.170961] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGH for action security_group_rules [ 1025.171459] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGH for action security_group_rules [ 1025.171459] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGH for action security_group_rules [ 1025.171459] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGH for action security_group_rules [ 1025.171459] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGH for action security_group_rules [ 1025.171656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.244425] env[65992]: INFO networking_nsxv3.common.synchronization [req-2152253e-0b82-445e-9afe-85a5643da12c req-635006da-7274-4341-b0b6-52ec4fee5679 service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 1025.244425] env[65992]: INFO networking_nsxv3.common.synchronization [req-2152253e-0b82-445e-9afe-85a5643da12c req-635006da-7274-4341-b0b6-52ec4fee5679 service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1025.244644] env[65992]: INFO networking_nsxv3.common.synchronization [req-2152253e-0b82-445e-9afe-85a5643da12c req-635006da-7274-4341-b0b6-52ec4fee5679 service nova] Enqueued Resource ID: 37980b2b-25be-4189-85ee-b607ae463276 with Priority: HIGHEST for action port [ 1025.245170] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 1025.245326] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1025.245426] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37980b2b-25be-4189-85ee-b607ae463276 with Priority: HIGHEST for action port [ 1025.245523] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGH for action security_group_rules [ 1025.245616] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 with Priority: HIGH for action security_group_rules [ 1025.245709] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 with Priority: HIGH for action security_group_rules [ 1025.245829] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf with Priority: HIGH for action security_group_rules [ 1025.245875] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e with Priority: HIGH for action security_group_rules [ 1025.245966] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 with Priority: HIGH for action security_group_rules [ 1025.246358] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe7e4325-0a58-45b0-b4d0-e088a125232f with Priority: HIGH for action security_group_rules [ 1025.246497] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9344356d-cfd9-4f69-96db-d4a162e98dce with Priority: HIGH for action security_group_rules [ 1025.246589] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGH for action security_group_rules [ 1025.246678] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 with Priority: HIGH for action security_group_rules [ 1025.246765] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 with Priority: HIGH for action security_group_rules [ 1025.246849] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGH for action security_group_rules [ 1025.246933] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGH for action security_group_rules [ 1025.247029] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGH for action security_group_rules [ 1025.247119] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGH for action security_group_rules [ 1025.247204] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb22631e-4990-471c-96cc-e4e5b0939818 with Priority: HIGH for action security_group_rules [ 1025.247288] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce with Priority: HIGH for action security_group_rules [ 1025.247379] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGH for action security_group_rules [ 1025.247480] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 with Priority: HIGH for action security_group_rules [ 1025.247577] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGH for action security_group_rules [ 1025.247888] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.248017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.248091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.248297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.248376] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.249699] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.249801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.250019] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-37980b2b-25be-4189-85ee-b607ae463276 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.250123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37980b2b-25be-4189-85ee-b607ae463276" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.250197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37980b2b-25be-4189-85ee-b607ae463276" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.250356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37980b2b-25be-4189-85ee-b607ae463276" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.250432] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37980b2b-25be-4189-85ee-b607ae463276',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.251839] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.251949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.252249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.252249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.252249] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.252993] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4017384d-1105-4cfb-b204-60d05dcc6f67 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.253120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.253185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.253968] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.254068] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4017384d-1105-4cfb-b204-60d05dcc6f67',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.254882] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.255011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.255503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.255806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.255894] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b1651ec-9ca7-4bf6-866b-28fade5b94c5',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.257480] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.257480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.257657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.257715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.257792] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc7601c-fb13-4bed-8af5-454bff4da6cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.259115] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.259274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.259274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.259457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.259542] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b258045-d8dd-4354-9ab0-f5fa8a21ca0e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.263259] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.263413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.263486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.263639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.263713] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fae6f001-d48c-45ec-8f59-9ecf82d77e91',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.264502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe7e4325-0a58-45b0-b4d0-e088a125232f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.264660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.264660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.264853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.264902] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe7e4325-0a58-45b0-b4d0-e088a125232f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.265613] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9344356d-cfd9-4f69-96db-d4a162e98dce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.265713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.265781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.265923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.265993] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9344356d-cfd9-4f69-96db-d4a162e98dce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.267544] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.267664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.267724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.267870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.268254] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.269156] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.269263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.269330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.269467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.269543] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8dbe3c7f-5b13-4659-b2e7-18c87792b278',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.270679] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-010c8cc5-bfff-46eb-9de7-49acf403b856 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.270679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.270679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.270993] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.270993] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('010c8cc5-bfff-46eb-9de7-49acf403b856',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.271838] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.271935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.272143] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.272237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.272293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.272433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.272501] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.273979] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.273979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.273979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.273979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.274368] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.275226] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.275345] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.275404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.275554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.275624] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.276296] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb22631e-4990-471c-96cc-e4e5b0939818 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.276402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.276467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.277139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.277323] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb22631e-4990-471c-96cc-e4e5b0939818',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.278462] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.278573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.278640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.278790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.279102] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58879f8e-8e07-40c8-a0c9-63ab056f38ce',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.279821] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.279938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.280021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.280167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.280235] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.281052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fe1c430-86c0-4a40-8a1c-596f267de734 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.281141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.281287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.281340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.281556] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fe1c430-86c0-4a40-8a1c-596f267de734',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.282108] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.282216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.282273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.282537] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.282537] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.770264] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.770707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.770707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.770707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.770900] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.770972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.771066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.771208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.771295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.771371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.771452] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.786091] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.786315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.786315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.786526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.786693] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.786793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.786839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.786982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.787101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.787168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.787252] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.788149] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37980b2b-25be-4189-85ee-b607ae463276 with status ACTIVE [ 1025.788323] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.788426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.788493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.788708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.788796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.788972] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.789078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.789139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.789286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.789428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.789575] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.789663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.789732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.789874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.789948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.790043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37980b2b-25be-4189-85ee-b607ae463276 is going to be updated. [ 1025.792905] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.793029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.793084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.793521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.793521] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.793521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.793728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.793728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.793810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.793889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.793972] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.796210] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.796210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.796386] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.796485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.796539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.796792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.796865] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.796963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.797046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.797185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.797258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.797350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.797476] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.800293] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.800293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.800293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.800293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.802319] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.802429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.802487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.802669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.802821] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.802917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.802979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.803129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.803206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.803288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.803427] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.803518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.803593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.803790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.803940] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.804047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.804108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.804244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.804332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.804424] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.804503] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.806438] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.806533] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.809019] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.809134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.809907] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.810018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.811794] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.811923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.811994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.812188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.812332] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.812427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.812487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.812627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.812704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.812783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.812862] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.814470] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.814610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.814724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.814929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.815098] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.815199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.815258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.815400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.815478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.815614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.815651] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.820917] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e720f82-4c36-4848-b271-696bfa23a791: rpc.has_security_group_logging(os_id): False [ 1025.824619] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.824619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.857576] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.857576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.858656] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.858908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.861068] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.861068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.861802] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.861802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.862695] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.862797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.864775] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.865585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.867165] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.867165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.867940] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.868043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.869229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.869433] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b1651ec-9ca7-4bf6-866b-28fade5b94c5 is going to be deleted. [ 1025.870906] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.871079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.871079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.871278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.875193] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.875332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.875385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.875571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.875704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.875881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37980b2b-25be-4189-85ee-b607ae463276" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.896293] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1025.897067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.897158] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.897238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.897415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.897562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.897649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.897832] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.897925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.897925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.898114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.898181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.898338] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.898576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.898576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.898808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.898808] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.898808] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1025.899873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.900043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.927335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.927492] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 010c8cc5-bfff-46eb-9de7-49acf403b856 is going to be deleted. [ 1025.928633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.928849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.952186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.952186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.969489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.969489] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8dbe3c7f-5b13-4659-b2e7-18c87792b278 is going to be deleted. [ 1025.970452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.970754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.008490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.009356] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4017384d-1105-4cfb-b204-60d05dcc6f67 is going to be deleted. [ 1026.009632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.009938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.011681] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.011805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.034299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.034575] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fe1c430-86c0-4a40-8a1c-596f267de734 is going to be deleted. [ 1026.035619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.035901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.041365] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.041556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.067584] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.067744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.071984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.071984] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe7e4325-0a58-45b0-b4d0-e088a125232f is going to be deleted. [ 1026.072834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.073095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.123458] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.123458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.180187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.180396] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be deleted. [ 1026.181498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.181781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.211566] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.211741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.213846] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1026.214105] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 1026.214241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.214440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.214597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.217213] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.217370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.217486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.217692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.217780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.217893] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.222143] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.222504] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.222750] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.223188] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.223738] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.224066] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.224318] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.224741] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.225036] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.225398] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.225650] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.225879] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.226116] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.226359] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.226586] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.226884] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.230654] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.241195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.241448] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9344356d-cfd9-4f69-96db-d4a162e98dce is going to be deleted. [ 1026.243834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.244224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.264137] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.264356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.274334] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.307161] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.310858] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.311109] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.311109] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.311354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.311548] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.311658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.311733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.311913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.312083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.312137] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.312260] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.312373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.312433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.312595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.312756] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.312861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.312924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.313101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.313239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.313272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.313453] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.315371] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.315622] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.089 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.315782] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.315949] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.316283] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-bca10115-1c7e-4f45-9979-e01934fb5db1 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.316564] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.316710] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.316959] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.317116] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca10115-1c7e-4f45-9979-e01934fb5db1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.318860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.318984] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58879f8e-8e07-40c8-a0c9-63ab056f38ce is going to be deleted. [ 1026.320951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.321035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.323646] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.324497] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.351488] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.351803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.372100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.372278] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb22631e-4990-471c-96cc-e4e5b0939818 is going to be deleted. [ 1026.373228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.373457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.396138] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.396329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.408018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.408165] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fae6f001-d48c-45ec-8f59-9ecf82d77e91 is going to be deleted. [ 1026.409455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.409673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.467803] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.467803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.468947] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.468947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.474972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.475135] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b258045-d8dd-4354-9ab0-f5fa8a21ca0e is going to be deleted. [ 1026.476169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.476261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.528557] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.528796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.529819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.529940] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc7601c-fb13-4bed-8af5-454bff4da6cf is going to be deleted. [ 1026.531235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.531464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.531553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.531687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b1651ec-9ca7-4bf6-866b-28fade5b94c5" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.531851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.532054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.532195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.533531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.533700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.533804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.533932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-010c8cc5-bfff-46eb-9de7-49acf403b856" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.534090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.534241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.534315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.534449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8dbe3c7f-5b13-4659-b2e7-18c87792b278" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.534885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4017384d-1105-4cfb-b204-60d05dcc6f67" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fe1c430-86c0-4a40-8a1c-596f267de734" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.536112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.536488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.536488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe7e4325-0a58-45b0-b4d0-e088a125232f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.536488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.536488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.536636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.536673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.536787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.536897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.537009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.537082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9344356d-cfd9-4f69-96db-d4a162e98dce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.537206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.537342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.537415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.537522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb22631e-4990-471c-96cc-e4e5b0939818" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.537760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.537908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.537983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.538106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58879f8e-8e07-40c8-a0c9-63ab056f38ce" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.538261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.538445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.538523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.538633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fae6f001-d48c-45ec-8f59-9ecf82d77e91" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.598376] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1026.598659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.738544] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.742495] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.742495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.742495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.742495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.742495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.742495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b258045-d8dd-4354-9ab0-f5fa8a21ca0e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.767881] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1026.768753] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.768753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.768753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.769121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.769237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.769400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc7601c-fb13-4bed-8af5-454bff4da6cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.777526] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09fa0638-1a13-4fbd-a918-e188dff752a0: rpc.has_security_group_logging(os_id): False [ 1026.803838] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.804133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.804186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.804470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.810606] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e35d0a29-9466-4e93-850f-29921a743936: rpc.has_security_group_logging(os_id): False [ 1026.823398] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6866765e-0cdc-4d35-aa21-1b0f99339ef0: rpc.has_security_group_logging(os_id): False [ 1026.825012] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.825250] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.825373] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.825759] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.825830] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.826099] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.826262] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.826375] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.826591] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.826722] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.827208] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.827487] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.827618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.827781] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.827910] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.828060] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: bca10115-1c7e-4f45-9979-e01934fb5db1 is going to be updated. [ 1026.829191] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c: rpc.has_security_group_logging(os_id): False [ 1026.830329] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58a9088b-471e-48ab-8bf1-877d11c93872: rpc.has_security_group_logging(os_id): False [ 1026.832229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.832503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.832625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.832683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.832857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.832935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.833035] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 is going to be updated. [ 1026.866865] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.867103] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.867200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.867413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.869176] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.869346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.870821] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.870962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.875824] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.875970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.893736] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.894060] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.894227] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.894511] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.894705] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.894979] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.914618] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.914881] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.915045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.915045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.915265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.915343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.915610] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.915812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.915899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.916012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.916074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.916292] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.916432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.916432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.916643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.916733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.916847] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 1026.917968] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.918260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.971305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.971541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.971682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.971727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.972346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.972434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.972541] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e35d0a29-9466-4e93-850f-29921a743936 is going to be updated. [ 1026.975828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.976065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.978676] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.978802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.032044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.032388] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.032839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.032839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.032839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.032991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.032991] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1027.034846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.035701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.038475] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.038609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.061385] env[65992]: INFO networking_nsxv3.common.synchronization [req-367c0630-648b-4052-a3b0-b2746b6bf70f req-aa56b483-6563-4271-b257-5704e6e0b167 tempest-ImagesOneServerNegativeTestJSON-1206007642 tempest-ImagesOneServerNegativeTestJSON-1206007642-project-member] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1027.062490] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1027.062490] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.062687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.062741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.062935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.063103] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.063232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.063308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.063526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.063642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.063766] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.090754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.091130] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.091230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.091300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.091501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.091584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.091678] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be updated. [ 1027.092767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.092963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.093123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.094452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.094452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.094585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.139026] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 in Status: IN_PROGRESS for 2s [ 1027.150092] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa4dd424-5723-4237-8888-a19ff8313111 in Status: SUCCESS [ 1027.150092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.156708] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 1027.170019] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.170238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.170238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.170439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.170633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.186323] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.186478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.186545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.186760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.186910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.199101] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e35d0a29-9466-4e93-850f-29921a743936 in Status: IN_PROGRESS for 2s [ 1027.203643] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1027.223159] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.223159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.223159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.223554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.223554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.244697] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.244926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.245138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.245889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.245997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.246097] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1027.267140] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: IN_PROGRESS for 2s [ 1027.328397] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.328610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.328610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.328813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.328983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.354802] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1027.545581] env[65992]: INFO networking_nsxv3.common.synchronization [req-d5945b21-b4cb-4c5e-82f6-79d77e5f68aa req-44df2efc-7247-4b68-900e-cce3f8e4e061 service nova] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_rules [ 1027.545873] env[65992]: INFO networking_nsxv3.common.synchronization [req-d5945b21-b4cb-4c5e-82f6-79d77e5f68aa req-44df2efc-7247-4b68-900e-cce3f8e4e061 service nova] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_members [ 1027.546077] env[65992]: INFO networking_nsxv3.common.synchronization [req-d5945b21-b4cb-4c5e-82f6-79d77e5f68aa req-44df2efc-7247-4b68-900e-cce3f8e4e061 service nova] Enqueued Resource ID: bca10115-1c7e-4f45-9979-e01934fb5db1 with Priority: HIGHEST for action port [ 1027.546773] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_rules [ 1027.547300] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_members [ 1027.547300] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca10115-1c7e-4f45-9979-e01934fb5db1 with Priority: HIGHEST for action port [ 1027.547746] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.548247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.548506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.548567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.548699] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.550230] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.550541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.550732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.551051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.551356] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.551546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.551692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.552009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.552192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.552354] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.553419] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-bca10115-1c7e-4f45-9979-e01934fb5db1 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.553621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.553780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.554061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.554221] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca10115-1c7e-4f45-9979-e01934fb5db1',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.566216] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.566371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.566475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.566730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.566866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.567133] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.567315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.567393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.567598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.567685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.567791] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1027.600555] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.600718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.600789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.601157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.601348] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.610104] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 1028.056491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.056491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.057039] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.057724] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bca10115-1c7e-4f45-9979-e01934fb5db1 with status ACTIVE [ 1028.057953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.058139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.058210] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.058453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.058566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.058755] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.058890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.058955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.059150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.059228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.059440] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.059570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.059690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.059893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.059996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.060103] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bca10115-1c7e-4f45-9979-e01934fb5db1 is going to be updated. [ 1028.085265] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.085265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.085265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.085265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.085265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.085494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bca10115-1c7e-4f45-9979-e01934fb5db1" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.562781] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.067593] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.068060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.068060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.068145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.068233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.068266] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a is going to be updated. [ 1029.113400] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.113598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.113664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.113862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.114051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.125152] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: IN_PROGRESS for 2s [ 1029.153775] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 in Status: SUCCESS [ 1029.154205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.170081] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 1029.170081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.218056] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1029.218289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.219066] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e35d0a29-9466-4e93-850f-29921a743936 in Status: SUCCESS [ 1029.219248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.282288] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 1029.282517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.368164] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1029.368164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.368164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.368164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.368164] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.368558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.368558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.368558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.368679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.368717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.369744] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.623901] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1029.623901] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 deletion is rescheduled due to dependency. [ 1029.623901] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.872703] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.873037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.873037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.873307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.873489] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.873595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.873660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.873812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.873902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.873986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.874156] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.874250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.874399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.874454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.874570] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.874762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.874762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.874931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.874931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.875096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.875096] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.378051] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a7f9db-1203-43be-8fe2-0b76907a767d: rpc.has_security_group_logging(os_id): False [ 1030.400048] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.400048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.400048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.400048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.420575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.420902] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.421030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.421030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.421279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.421338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.421502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.421651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.421651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.421793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.421858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.422071] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.422166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.422260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.422358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.422414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.422553] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1030.488142] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.488325] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.488395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.488605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.488749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.505898] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1031.138865] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: SUCCESS [ 1031.138865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.138865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.139086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.140546] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.140546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.140546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.140546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.140546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.140546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.140546] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.642841] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.147498] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85011876-1ce8-49d5-9b25-2c9588597a4a: rpc.has_security_group_logging(os_id): False [ 1032.168490] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.168683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.168737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.168937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.189090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.189460] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.189885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.189953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.190170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.190301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.190341] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a is going to be updated. [ 1032.251813] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.252078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.252169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.252425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.252660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.269490] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: IN_PROGRESS for 2s [ 1032.529314] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1032.530214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.530629] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.530929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.531029] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.549726] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1032.550242] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1032.568100] env[65992]: INFO networking_nsxv3.common.synchronization [req-7910d980-4a7a-43b9-811f-b35436e48f19 req-b086246e-86bc-4b63-87a5-8c06c741feb9 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1032.568807] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1032.570634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.570822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.570890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.571873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.571873] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.571873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.571873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.571873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.571873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.571873] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.038417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.038417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.038417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.038417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.038417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.038417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.038417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.038417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.038417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.038417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.038417] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.075222] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.541738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.541738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.541738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.542017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.542209] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.542363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.542554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.542761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.542875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.543028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.543263] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.543400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.543482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.543637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.543791] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.543903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.543996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.544183] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.544262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.544343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.544427] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.577950] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.051256] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a7f9db-1203-43be-8fe2-0b76907a767d: rpc.has_security_group_logging(os_id): False [ 1034.070379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.070574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.070574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.070831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.070925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.071135] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.071239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.071302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.071453] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.071528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.071766] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.071913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.071980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.072159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.072232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.072438] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.072524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.072569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.072783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.072783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.072884] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1034.083780] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.083960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.083960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.084152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.084231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.085024] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1034.116132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.116803] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.117457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.117636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.118282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.129457] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1034.137741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.137934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.138036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.138254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.138395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.155726] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1034.286105] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: SUCCESS [ 1034.286105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.525348] env[65992]: INFO networking_nsxv3.common.synchronization [None req-30f87842-4e95-411e-a9f3-d99e5d5ee02f None None] Enqueued Resource ID: 60333e98-90fe-4df4-b1f2-4845e4fcf8ec with Priority: HIGHEST for action port [ 1034.525348] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60333e98-90fe-4df4-b1f2-4845e4fcf8ec with Priority: HIGHEST for action port [ 1034.525547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-60333e98-90fe-4df4-b1f2-4845e4fcf8ec taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.527342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60333e98-90fe-4df4-b1f2-4845e4fcf8ec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.527342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60333e98-90fe-4df4-b1f2-4845e4fcf8ec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.527342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60333e98-90fe-4df4-b1f2-4845e4fcf8ec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.527342] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60333e98-90fe-4df4-b1f2-4845e4fcf8ec',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.030315] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60333e98-90fe-4df4-b1f2-4845e4fcf8ec [ 1035.030739] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.030739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.031022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.031063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.031173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.031277] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60333e98-90fe-4df4-b1f2-4845e4fcf8ec already deleted. [ 1035.031378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60333e98-90fe-4df4-b1f2-4845e4fcf8ec" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.142441] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1036.142918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.178039] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1036.178389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.698482] env[65992]: INFO networking_nsxv3.common.synchronization [None req-0a4aec02-77b2-403d-8b7e-6352574364a8 None None] Enqueued Resource ID: f8f64cd5-2602-4d0e-86c8-a6d07981d28f with Priority: HIGHEST for action port [ 1037.698966] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f64cd5-2602-4d0e-86c8-a6d07981d28f with Priority: HIGHEST for action port [ 1037.699305] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8f64cd5-2602-4d0e-86c8-a6d07981d28f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.699430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8f64cd5-2602-4d0e-86c8-a6d07981d28f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.699495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8f64cd5-2602-4d0e-86c8-a6d07981d28f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.699797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8f64cd5-2602-4d0e-86c8-a6d07981d28f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.699894] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f64cd5-2602-4d0e-86c8-a6d07981d28f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.202291] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8f64cd5-2602-4d0e-86c8-a6d07981d28f [ 1038.202546] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.202671] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.202848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.202959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.203043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.203137] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8f64cd5-2602-4d0e-86c8-a6d07981d28f already deleted. [ 1038.203513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8f64cd5-2602-4d0e-86c8-a6d07981d28f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.700378] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1042.700659] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1047.702019] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1047.702401] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1048.215768] env[65992]: INFO networking_nsxv3.common.synchronization [req-87daef31-d685-47ff-84db-ccde6935b730 req-1afc3cf2-4a69-4a35-a5e5-caf89f615dbe tempest-ServerRescueNegativeTestJSON-1377566600 tempest-ServerRescueNegativeTestJSON-1377566600-project-member] Enqueued Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1048.216367] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1048.216677] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.216800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.216865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.217319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.217491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.219585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.219585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.219585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.219585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.219585] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.589861] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.589861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.589861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.589861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.589861] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.591383] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.591383] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.592037] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.592182] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.592412] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.592577] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.592755] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.592918] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.593142] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.593383] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.593466] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.619828] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.620081] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.620236] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.620564] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.620728] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.620890] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.621079] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.621388] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.621528] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2ed24f7-f2c4-4684-9cad-2f29a5c20057',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.722676] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.722676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.722676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.723138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.723138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.723138] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.723293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.723293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.723794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.723794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.723794] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 already deleted. [ 1048.723794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.123557] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.123807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.123935] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.124285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.124433] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.124586] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port d2ed24f7-f2c4-4684-9cad-2f29a5c20057 not found, creating... [ 1049.124848] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.125008] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.125229] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.125445] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.125577] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.125909] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.126153] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.126216] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.126403] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.126533] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.126683] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: d2ed24f7-f2c4-4684-9cad-2f29a5c20057 is going to be created. [ 1049.148936] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.148936] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.148936] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.149261] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.149424] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.149648] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.479055] env[65992]: INFO networking_nsxv3.common.synchronization [req-4de4b8de-1325-4773-918b-904624e774c2 req-04e41ac8-3f79-4f8f-a93a-52e94d9403f7 tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_members [ 1049.479712] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGHEST for action security_group_members [ 1049.480112] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.480229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.480297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.480486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.480631] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.480721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.480773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.481030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.481139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.481233] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.888441] env[65992]: INFO networking_nsxv3.common.synchronization [req-87daef31-d685-47ff-84db-ccde6935b730 req-6bac4092-1a4a-4475-9eb9-2de12a1942a2 service nova] Enqueued Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_rules [ 1049.888709] env[65992]: INFO networking_nsxv3.common.synchronization [req-87daef31-d685-47ff-84db-ccde6935b730 req-6bac4092-1a4a-4475-9eb9-2de12a1942a2 service nova] Enqueued Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1049.888803] env[65992]: INFO networking_nsxv3.common.synchronization [req-87daef31-d685-47ff-84db-ccde6935b730 req-6bac4092-1a4a-4475-9eb9-2de12a1942a2 service nova] Enqueued Resource ID: d2ed24f7-f2c4-4684-9cad-2f29a5c20057 with Priority: HIGHEST for action port [ 1049.889361] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_rules [ 1049.889497] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1049.889592] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ed24f7-f2c4-4684-9cad-2f29a5c20057 with Priority: HIGHEST for action port [ 1049.889881] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.891255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.891376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.891661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.891748] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.892738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.892869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.892938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.893304] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.893476] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.893578] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.893637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.893796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.893879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.893981] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.897845] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.897845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.897845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.897845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.897845] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2ed24f7-f2c4-4684-9cad-2f29a5c20057',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.983040] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.983240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.983302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.983494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.983579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.983774] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.983871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.983935] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.984094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.984189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.984313] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 is going to be updated. [ 1050.025064] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.025327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.025327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.025529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.025661] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.037252] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 in Status: IN_PROGRESS for 2s [ 1050.398973] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.400258] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.400258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.400646] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2ed24f7-f2c4-4684-9cad-2f29a5c20057 with status ACTIVE [ 1050.400846] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.401013] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.401261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.401472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.401624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.401773] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.401846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.401917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.402164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.402247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.402464] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.402557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.402666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.402787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.402834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.402907] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2ed24f7-f2c4-4684-9cad-2f29a5c20057 is going to be updated. [ 1050.425752] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.426152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.426279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.426460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.426597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.426757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2ed24f7-f2c4-4684-9cad-2f29a5c20057" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.701852] env[65992]: INFO networking_nsxv3.common.synchronization [req-3e5cc7e1-d515-4415-ab9a-da2879ff3e8c req-044320f3-99a5-404c-a1f3-9ca92928b0da tempest-ServerRescueNegativeTestJSON-1377566600 tempest-ServerRescueNegativeTestJSON-1377566600-project-member] Enqueued Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1050.702472] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1050.702788] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.702932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.903471] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.029414] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.029739] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.029942] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.030691] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.031145] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.031885] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.031885] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.032370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.032608] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.032926] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.033147] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.033338] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.033522] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.033711] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.033893] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.034219] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.054699] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.054890] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1051.055079] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.055275] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.055721] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.055935] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.056050] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.056510] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.056727] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.405602] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.405841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.405841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.406073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.406164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.406265] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 is going to be created. [ 1051.431899] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.432084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.432135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.432470] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.432638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.443361] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: UNINITIALIZED for 2s [ 1051.560753] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.560753] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.560753] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.560924] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.561072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.561352] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a not found, creating... [ 1051.561521] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.562469] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.562469] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.562469] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.562469] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.562891] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.562891] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.562891] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.563079] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.563208] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.563342] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a is going to be created. [ 1051.586931] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.587395] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.587529] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.587822] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.588074] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.588306] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.055994] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 in Status: SUCCESS [ 1052.056375] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 deletion is rescheduled due to dependency. [ 1052.056375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.394296] env[65992]: INFO networking_nsxv3.common.synchronization [req-3e5cc7e1-d515-4415-ab9a-da2879ff3e8c req-05602a5f-495f-4c72-9eca-00ee3ca678ae service nova] Enqueued Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_rules [ 1052.394296] env[65992]: INFO networking_nsxv3.common.synchronization [req-3e5cc7e1-d515-4415-ab9a-da2879ff3e8c req-05602a5f-495f-4c72-9eca-00ee3ca678ae service nova] Enqueued Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1052.394296] env[65992]: INFO networking_nsxv3.common.synchronization [req-3e5cc7e1-d515-4415-ab9a-da2879ff3e8c req-05602a5f-495f-4c72-9eca-00ee3ca678ae service nova] Enqueued Resource ID: 1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a with Priority: HIGHEST for action port [ 1052.394296] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_rules [ 1052.395405] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1052.395843] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a with Priority: HIGHEST for action port [ 1052.397285] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.397673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.398918] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.399729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.401586] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.401895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.402587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.402587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.402894] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.906598] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a with status ACTIVE [ 1052.907178] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.907178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.907378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.907792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.907792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.907964] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.908215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.908215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.908439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.908493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.908875] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.908875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.908875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.909053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.909126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.909226] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a is going to be updated. [ 1052.934816] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.935080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.935080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.935275] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.935431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.935606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ff49c35-0c57-4c34-bf48-ceb6d2ffd25a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.453616] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: SUCCESS [ 1053.453918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.453918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.454358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.454544] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.454698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.454732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.454882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.454965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.455132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.455215] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.456072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.456309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.456465] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.456592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.456688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.456838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.456937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.456997] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.960093] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.960240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.960448] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.462929] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.966313] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.966476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.966532] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.966828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.967428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.967428] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 is going to be updated. [ 1055.001131] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.001374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.001374] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.001560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.002109] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.012811] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: IN_PROGRESS for 2s [ 1056.243797] env[65992]: INFO networking_nsxv3.common.synchronization [req-0f13ab51-47bd-477d-85d8-1e0edbb66df0 req-40e57605-834b-4edc-b418-a3d38eab8751 tempest-ImagesOneServerNegativeTestJSON-1206007642 tempest-ImagesOneServerNegativeTestJSON-1206007642-project-member] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1056.243797] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1056.243797] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.246247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.246247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.246247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.246247] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.246247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.246247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.246247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.247061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.247061] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.663270] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-843 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.663684] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.663914] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.664326] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.664608] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.664795] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.664899] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.665156] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.665337] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.665555] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.665739] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.665846] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.666033] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.666228] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.666534] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.666706] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.690831] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.691145] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.691145] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.691327] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-843" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.691716] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-8c7caf3e-a15d-4703-886b-4f29ef064c8c taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.691840] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-8c7caf3e-a15d-4703-886b-4f29ef064c8c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.691960] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-8c7caf3e-a15d-4703-886b-4f29ef064c8c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.692324] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-8c7caf3e-a15d-4703-886b-4f29ef064c8c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.692510] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c7caf3e-a15d-4703-886b-4f29ef064c8c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.748846] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.749032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.749094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.749400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.749527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.749748] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.749883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.749966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.750211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.750319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.750439] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1056.780096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.780268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.780268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.780480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.780610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.790236] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 1057.022911] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: SUCCESS [ 1057.023149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.023329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.023554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.024053] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.024189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.024351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.024426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.024503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.024599] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.047639] env[65992]: INFO networking_nsxv3.common.synchronization [req-6f8b019c-df36-4272-bd58-7425efd58fec req-376ccaf5-1520-47a4-8aea-3e676d76e0a4 tempest-DeleteServersTestJSON-1622758553 tempest-DeleteServersTestJSON-1622758553-project-member] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 1057.048305] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGHEST for action security_group_members [ 1057.048687] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.048852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.048933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.049165] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.049381] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.049498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.049566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.049757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.049848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.049956] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.195790] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.196216] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.196974] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.196974] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.196974] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.197269] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 8c7caf3e-a15d-4703-886b-4f29ef064c8c not found, creating... [ 1057.197445] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.197701] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.197867] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.198261] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.198405] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.198793] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.199043] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.199233] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.199509] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.199655] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.199799] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 8c7caf3e-a15d-4703-886b-4f29ef064c8c is going to be created. [ 1057.224372] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.224372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.224372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.224589] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.224968] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.225308] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-8c7caf3e-a15d-4703-886b-4f29ef064c8c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.527246] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.554538] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.554699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.554816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.555076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.555176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.555373] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.555488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.555552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.555760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.555812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.555871] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be updated. [ 1057.583823] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.584053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.584123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.584905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.584905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.594280] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: IN_PROGRESS for 2s [ 1058.030046] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.278375] env[65992]: INFO networking_nsxv3.common.synchronization [req-0f13ab51-47bd-477d-85d8-1e0edbb66df0 req-cc82a9cb-8683-4baf-acb2-6a764345adba service nova] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_rules [ 1058.278654] env[65992]: INFO networking_nsxv3.common.synchronization [req-0f13ab51-47bd-477d-85d8-1e0edbb66df0 req-cc82a9cb-8683-4baf-acb2-6a764345adba service nova] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1058.278796] env[65992]: INFO networking_nsxv3.common.synchronization [req-0f13ab51-47bd-477d-85d8-1e0edbb66df0 req-cc82a9cb-8683-4baf-acb2-6a764345adba service nova] Enqueued Resource ID: 8c7caf3e-a15d-4703-886b-4f29ef064c8c with Priority: HIGHEST for action port [ 1058.280414] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_rules [ 1058.280575] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1058.280631] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7caf3e-a15d-4703-886b-4f29ef064c8c with Priority: HIGHEST for action port [ 1058.280969] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.281067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.281164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.282891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.282891] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.282891] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.282891] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.283326] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c7caf3e-a15d-4703-886b-4f29ef064c8c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.283326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c7caf3e-a15d-4703-886b-4f29ef064c8c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.283326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c7caf3e-a15d-4703-886b-4f29ef064c8c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.284934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c7caf3e-a15d-4703-886b-4f29ef064c8c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.285044] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c7caf3e-a15d-4703-886b-4f29ef064c8c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.532594] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.532912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.533023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.533302] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.533438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.533556] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 is going to be updated. [ 1058.584603] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.584805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.584805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.585066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.585241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.598254] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: IN_PROGRESS for 2s [ 1058.724755] env[65992]: INFO networking_nsxv3.common.synchronization [req-60068310-abba-473d-bb31-16132b7b7f38 req-ebe7f51d-0e3e-447e-aec6-c56eadbd0413 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1058.726027] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1058.726027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.726027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.726284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.726326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.726585] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.726688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.726751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.726952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.727082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.727207] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.786890] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.787054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.787258] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c7caf3e-a15d-4703-886b-4f29ef064c8c with status ACTIVE [ 1058.787461] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.787596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.787699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.787936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.788178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.788419] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.788530] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.788648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.788812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.788893] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.789095] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.789194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.789255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.789391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.789465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.789549] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c7caf3e-a15d-4703-886b-4f29ef064c8c is going to be updated. [ 1058.802675] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1058.802675] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 deletion is rescheduled due to dependency. [ 1058.802675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.803018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.803018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.803218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.803347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.803347] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.804027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.804027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.804027] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.816481] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.816745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.816745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.816908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.817185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.817282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c7caf3e-a15d-4703-886b-4f29ef064c8c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.094159] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.094505] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.094697] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.095057] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.095412] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.095614] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.095775] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.096078] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.096435] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.096827] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.097026] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.097158] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.097276] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.097436] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.097581] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.097775] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.118748] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.118957] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.119103] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.119355] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.119714] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.119971] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.120188] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.120517] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.120636] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.229950] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.306481] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.608659] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 in Status: SUCCESS [ 1059.608659] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 deletion is rescheduled due to dependency. [ 1059.608659] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.623251] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.623643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.623643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.624048] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.624415] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.624555] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b not found, creating... [ 1059.624791] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.624942] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.625121] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.625345] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.625397] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.625699] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.625849] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.625960] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.626178] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.626310] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.626428] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b is going to be created. [ 1059.651452] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.651744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.651897] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.652242] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.652550] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.652826] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.732147] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.810668] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.234982] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.235187] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.235283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.236487] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.236621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.236778] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1060.287126] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.287636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.290034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.290034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.290034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.301503] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1060.314658] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.314658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.314658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.314658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.314658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.314658] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1060.349868] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.349868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.349868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.353910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.353910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.363484] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 1060.428856] env[65992]: INFO networking_nsxv3.common.synchronization [req-60068310-abba-473d-bb31-16132b7b7f38 req-803b7db9-30ce-45f7-a5a3-1a63888bd47b service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 1060.429091] env[65992]: INFO networking_nsxv3.common.synchronization [req-60068310-abba-473d-bb31-16132b7b7f38 req-803b7db9-30ce-45f7-a5a3-1a63888bd47b service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1060.429265] env[65992]: INFO networking_nsxv3.common.synchronization [req-60068310-abba-473d-bb31-16132b7b7f38 req-803b7db9-30ce-45f7-a5a3-1a63888bd47b service nova] Enqueued Resource ID: 0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b with Priority: HIGHEST for action port [ 1060.429892] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 1060.430378] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1060.430559] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b with Priority: HIGHEST for action port [ 1060.430969] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.431163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.431259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.431498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.431619] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.432659] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.432790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.433642] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.433642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.433642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.433642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.433642] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.609111] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: SUCCESS [ 1060.609567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.609786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.610110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.610411] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.610595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.610702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.610928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.611084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.611241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.611516] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.611651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.611744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.611950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.612186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.612350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.612446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.612626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.612789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.612885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.613018] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.936343] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.936529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.936784] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b with status ACTIVE [ 1060.937055] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.937197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.937262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.937494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.937583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.937804] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.937907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.937995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.938221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.938336] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.938545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.938651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.938724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.938897] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.938974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.939078] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b is going to be updated. [ 1060.962680] env[65992]: INFO networking_nsxv3.common.synchronization [req-030e3b8e-47ff-44ef-9265-c481ba05c7e5 req-a5d8b9f9-30ff-4ac5-ba3a-c38725140f1e tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_members [ 1060.964933] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGHEST for action security_group_members [ 1060.964933] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.964933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.964933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.965523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.965523] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.965523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.965768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.965886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.965976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.966114] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.969469] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.969653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.969810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.970084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.970253] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.970536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d5f1158-2192-49e6-a1a9-3e2a3ea5f21b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.118612] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50f8b602-7d1f-4e01-aba4-88750c95b873: rpc.has_security_group_logging(os_id): False [ 1061.145625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.145625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.145625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.145898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.145968] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.146164] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.146273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.146355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.146522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.146601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.146821] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.146932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.146985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.147150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.147224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.147652] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.147652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.147652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.147908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.147908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.147908] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 is going to be created. [ 1061.246452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.247294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.247294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.247294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.247294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.272532] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: IN_PROGRESS for 2s [ 1061.473170] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.473475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.473593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.473786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.473878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.474097] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.474192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.474246] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.474432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.474525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.474632] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e35d0a29-9466-4e93-850f-29921a743936 is going to be updated. [ 1061.510479] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.510722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.510819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.511279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.511490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.523503] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e35d0a29-9466-4e93-850f-29921a743936 in Status: IN_PROGRESS for 2s [ 1061.803689] env[65992]: INFO networking_nsxv3.common.synchronization [req-81886acc-b20c-4062-8f69-e4c735f68080 req-2633651a-ca90-4fa4-bcfb-edbfa37bf963 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1061.803689] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1061.803689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.803689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.803689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.803689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.804352] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.804352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.804352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.804352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.804352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.804352] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.113986] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.114231] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.114361] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.114672] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.114957] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.115291] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.115439] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.115716] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.115878] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.116138] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.116928] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.116928] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.116928] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.116928] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.116928] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.116928] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.137132] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.139017] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.139017] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.139017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.139017] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-a1841121-a2c1-4f43-9f40-963e14306a0b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.139017] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-a1841121-a2c1-4f43-9f40-963e14306a0b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.139328] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-a1841121-a2c1-4f43-9f40-963e14306a0b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.139509] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-a1841121-a2c1-4f43-9f40-963e14306a0b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.139651] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1841121-a2c1-4f43-9f40-963e14306a0b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.306521] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.306755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.306885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.307205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.307343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.307635] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.307811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.307896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.308121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.308260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.308394] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 already deleted. [ 1062.308520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.319095] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1062.319346] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.319923] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.320186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.320379] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.320500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.320566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.320718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.320798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.320890] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.376089] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1062.376311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.377095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.377095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.377186] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.377748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.377748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.377748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.378160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.378160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.378160] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.642820] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.642820] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.643144] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.643603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.643603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.643827] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port a1841121-a2c1-4f43-9f40-963e14306a0b not found, creating... [ 1062.644140] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.644310] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.644434] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.644662] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.644805] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.645399] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.645399] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.645540] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.645744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.645820] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.645965] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: a1841121-a2c1-4f43-9f40-963e14306a0b is going to be created. [ 1062.670417] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.670622] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.670747] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.671059] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.671285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.671619] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-a1841121-a2c1-4f43-9f40-963e14306a0b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.824428] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.882792] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.883638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.884597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.884597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.884597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.884953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.884953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.885172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.885290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.885482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.885752] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.885910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.886298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.886298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.886298] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.886502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.886575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.886739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.886833] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.887589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.887589] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.287766] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: SUCCESS [ 1063.288083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.288388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.288623] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.288714] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.326909] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.394477] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e720f82-4c36-4848-b271-696bfa23a791: rpc.has_security_group_logging(os_id): False [ 1063.394477] env[65992]: INFO networking_nsxv3.common.synchronization [req-81886acc-b20c-4062-8f69-e4c735f68080 req-94a4d56c-a7a2-428c-9d06-82ec2c290543 service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1063.394477] env[65992]: INFO networking_nsxv3.common.synchronization [req-81886acc-b20c-4062-8f69-e4c735f68080 req-94a4d56c-a7a2-428c-9d06-82ec2c290543 service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1063.394477] env[65992]: INFO networking_nsxv3.common.synchronization [req-81886acc-b20c-4062-8f69-e4c735f68080 req-94a4d56c-a7a2-428c-9d06-82ec2c290543 service nova] Enqueued Resource ID: a1841121-a2c1-4f43-9f40-963e14306a0b with Priority: HIGHEST for action port [ 1063.395748] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1063.395748] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1063.395884] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1841121-a2c1-4f43-9f40-963e14306a0b with Priority: HIGHEST for action port [ 1063.396373] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.396621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.396691] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.397228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.397412] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.398883] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.398972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.399038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.399250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.399421] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.399531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.399572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.399720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.400748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.400748] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.401562] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1841121-a2c1-4f43-9f40-963e14306a0b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.401562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1841121-a2c1-4f43-9f40-963e14306a0b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.401562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1841121-a2c1-4f43-9f40-963e14306a0b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.401766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1841121-a2c1-4f43-9f40-963e14306a0b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.401766] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1841121-a2c1-4f43-9f40-963e14306a0b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.414335] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.414557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.414557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.415263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.415263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.415263] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.415263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.415263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.415670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.415670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.415670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.415895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.415895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.416026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.416026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.416347] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.416500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.416500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.416682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.416682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.417105] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1063.494437] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.494756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.494888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.495124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.495356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.513259] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 1063.536921] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e35d0a29-9466-4e93-850f-29921a743936 in Status: SUCCESS [ 1063.537295] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e35d0a29-9466-4e93-850f-29921a743936 deletion is rescheduled due to dependency. [ 1063.537485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.793251] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.793425] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.793495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.793726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.793861] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.793959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.794051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.794160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.794322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.794414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.794497] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.829037] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.829363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.829363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.829501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.829544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.829645] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1063.864152] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.864300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.864355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.864551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.864692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.880018] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1063.903742] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.904956] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.905074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.905166] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1841121-a2c1-4f43-9f40-963e14306a0b with status ACTIVE [ 1063.905323] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.905430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.905518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.905688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.905820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.905936] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.906149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.906149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.906277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.906315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.906485] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.906579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.906632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.906767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.906856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.906938] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1841121-a2c1-4f43-9f40-963e14306a0b is going to be updated. [ 1063.931301] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.931502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.931596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.931806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.931938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.932115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1841121-a2c1-4f43-9f40-963e14306a0b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.297216] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.297380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.297442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.297690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.297862] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.298015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.298015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.298175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.298270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.298356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.298483] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.298602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.298682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.298807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.299039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.299207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.299287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.299355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.299442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.299519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.299598] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.410996] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.802008] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50f8b602-7d1f-4e01-aba4-88750c95b873: rpc.has_security_group_logging(os_id): False [ 1064.822119] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.822293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.822394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.822651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.822753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.822956] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.823072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.823132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.823293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.823378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.823547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.823640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.823877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.823877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.823942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.824097] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.824189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.824247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.824378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.824445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.824526] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 is going to be updated. [ 1064.884930] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.885742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.885742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.885742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.885742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.903912] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: IN_PROGRESS for 2s [ 1064.914632] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.915026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.915026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.915377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.915377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.915540] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be created. [ 1064.940878] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.941129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.941249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.941590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.941817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.961016] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: UNINITIALIZED for 2s [ 1065.537666] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1065.537666] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.890156] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1065.890605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.891204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.891436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.891649] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.891822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.891822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.892219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.892219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.892219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.892383] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.395921] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.396170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.396170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.396439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.396640] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.396782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.396849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.397580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.397801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.397801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.398242] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.398242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.398242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.398468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.398640] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.398742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.398804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.398949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.399071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.399136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.399201] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.902790] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6417014f-241b-4b36-8b7b-aeef9e200013: rpc.has_security_group_logging(os_id): False [ 1066.917604] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: SUCCESS [ 1066.917832] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.919950] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.920102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.920667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.920914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.942712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.943047] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.943214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.943285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.943476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.943567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.943761] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.943870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.943933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.944110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.944195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.944402] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.944513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.944751] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.944877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.944914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.945037] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1066.974265] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1066.974379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.974521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.974804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.975043] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.975236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.975309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.975479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.975557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.975654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.975745] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.015082] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.015329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.015413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.016023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.016023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.038321] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1067.478879] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.479068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.479143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.479371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.479551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.479655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.479720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.479875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.479963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.480067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.480218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.480354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.480419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.480564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.480707] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.480799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.480869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.480996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.481079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.481163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.481281] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.984262] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a25c9a9c-e9a8-445f-ad80-439686ed1021: rpc.has_security_group_logging(os_id): False [ 1068.006517] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.006517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.006517] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.006743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.006743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.006869] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.006958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.007035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.007186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.007262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.007455] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.007556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.007699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.007749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.007825] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.008026] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.008334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.008334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.008446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.008446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.008595] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be created. [ 1068.078533] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.078725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.078725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.078982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.079247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.096433] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1068.397327] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1068.398592] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1069.058318] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1069.058645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.108513] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1070.108899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.972733] env[65992]: INFO networking_nsxv3.common.synchronization [req-5d259d07-194c-4806-95d1-82e8ab23b6b9 req-a10cedbf-1c56-4d3e-890d-d8f634da3d2a tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_members [ 1070.973342] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGHEST for action security_group_members [ 1070.974092] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa4dd424-5723-4237-8888-a19ff8313111 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.974299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.974462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.974824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.974976] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.975197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.975239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.975420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.975532] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.975644] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.478976] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.479326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.479326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.479505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.479586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.479736] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.479859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.479908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.481827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.481827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.481827] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa4dd424-5723-4237-8888-a19ff8313111 is going to be updated. [ 1071.513235] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.513489] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.513604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.513938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.514143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.526735] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa4dd424-5723-4237-8888-a19ff8313111 in Status: IN_PROGRESS for 2s [ 1071.581169] env[65992]: INFO networking_nsxv3.common.synchronization [req-302013a9-c29b-4ea6-8f9d-e387ec707069 req-01da9a14-f9a6-45bf-94c0-1e03f9ac0787 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1071.582815] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1071.582815] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.582815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.582815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.582815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.583102] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.583102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.583102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.583329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.583442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.583558] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.950060] env[65992]: INFO networking_nsxv3.common.synchronization [req-d9c8181c-fb61-4f4d-b64b-334f9ef24a55 req-1f5a69f4-9530-48e2-8534-814471e92c06 tempest-ImagesOneServerNegativeTestJSON-1206007642 tempest-ImagesOneServerNegativeTestJSON-1206007642-project-member] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1071.950804] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGHEST for action security_group_members [ 1071.951138] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.951432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.951432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.951587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.951683] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.951775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.951834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.951973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.952067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.952159] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.089078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.089078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.089078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.089078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.089078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.089078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.089078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.089078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.089078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.089078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.089078] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1072.121044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.121189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.121224] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.121469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.121574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.138180] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1072.456258] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.456258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.456258] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.458508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.458508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.458508] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.458508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.458508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.458508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.458508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.458508] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be updated. [ 1072.469566] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d19127d9-7bd9-4a56-898b-ebd91db03cc6 None None] Enqueued Resource ID: 3ecd1d5a-b37c-4259-8d87-af2153ad083f with Priority: HIGHEST for action port [ 1072.470203] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ecd1d5a-b37c-4259-8d87-af2153ad083f with Priority: HIGHEST for action port [ 1072.470477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ecd1d5a-b37c-4259-8d87-af2153ad083f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.470611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ecd1d5a-b37c-4259-8d87-af2153ad083f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.470667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ecd1d5a-b37c-4259-8d87-af2153ad083f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.473651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ecd1d5a-b37c-4259-8d87-af2153ad083f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.473651] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ecd1d5a-b37c-4259-8d87-af2153ad083f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.503826] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.503826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.503826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.503826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.503826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.519636] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: IN_PROGRESS for 2s [ 1072.976251] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ecd1d5a-b37c-4259-8d87-af2153ad083f [ 1072.976535] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.976698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.976838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.977146] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.977284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.977418] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ecd1d5a-b37c-4259-8d87-af2153ad083f already deleted. [ 1072.977554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ecd1d5a-b37c-4259-8d87-af2153ad083f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.537063] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa4dd424-5723-4237-8888-a19ff8313111 in Status: SUCCESS [ 1073.537510] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa4dd424-5723-4237-8888-a19ff8313111 deletion is rescheduled due to dependency. [ 1073.537768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.164584] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1074.165503] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 1074.165750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.530172] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e720f82-4c36-4848-b271-696bfa23a791 in Status: SUCCESS [ 1074.530408] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 deletion is rescheduled due to dependency. [ 1074.530542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.085929] env[65992]: INFO networking_nsxv3.common.synchronization [req-0f0e2811-425d-4471-be3f-247c7da54071 req-93b846a7-8a1c-4f28-8b34-ab5f98c5953c tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 1075.087034] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 1075.087034] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.087034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.087270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.087270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.087827] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.087827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.087827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.087827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.087827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.089296] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.590023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.590241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.590290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.590716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.590828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.591124] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.591299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.591443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.591642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.591730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.591846] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be deleted. [ 1075.601932] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.602224] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.602389] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.602651] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.602911] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.603236] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.603371] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.603791] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.603952] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.604086] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.604202] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.604310] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.604414] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.604522] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.604622] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.604750] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.626898] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.627118] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1075.627303] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.627489] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.627811] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-b099d434-5c90-4dfd-bf36-60dbb660140f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.627982] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.628113] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.628447] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.628583] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b099d434-5c90-4dfd-bf36-60dbb660140f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.638835] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.639070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.639120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.639318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.639413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.639504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.682746] env[65992]: INFO networking_nsxv3.common.synchronization [req-78e156e9-a3b6-41ae-a97e-804968029512 req-09dc4dc3-a253-408f-a3d3-2ba708015cbb tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1075.683255] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1075.683558] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.683696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.683763] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.683953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.684119] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.684214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.684531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.684531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.684531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.684741] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.060096] env[65992]: INFO networking_nsxv3.common.synchronization [req-42184709-ab8e-41ef-9a83-4ff4f17acd41 req-e7f6de3e-9109-4339-9c04-6d5153185599 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1076.060698] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1076.061015] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.061144] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.061670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.061883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.062063] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.063066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.063066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.063066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.063066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.063066] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.131591] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.132098] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.132227] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.132707] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.132907] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.133024] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port b099d434-5c90-4dfd-bf36-60dbb660140f not found, creating... [ 1076.133308] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.133486] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.134030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.134030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.134030] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.134322] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.134482] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.135061] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.135061] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.135061] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.135061] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: b099d434-5c90-4dfd-bf36-60dbb660140f is going to be created. [ 1076.169563] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.169793] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.169968] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.171486] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.171486] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.171486] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.189285] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.565238] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.565399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.565454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.565653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.565744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.565936] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.566046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.566101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.566280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.566372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.566415] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1076.595942] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.596177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.596177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.596364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.596513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.606328] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1076.692033] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.879614] env[65992]: INFO networking_nsxv3.common.synchronization [req-0f0e2811-425d-4471-be3f-247c7da54071 req-159716da-e4a4-4e27-ba8a-db0f9c54d23d service nova] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_rules [ 1076.879733] env[65992]: INFO networking_nsxv3.common.synchronization [req-0f0e2811-425d-4471-be3f-247c7da54071 req-159716da-e4a4-4e27-ba8a-db0f9c54d23d service nova] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 1076.879835] env[65992]: INFO networking_nsxv3.common.synchronization [req-0f0e2811-425d-4471-be3f-247c7da54071 req-159716da-e4a4-4e27-ba8a-db0f9c54d23d service nova] Enqueued Resource ID: b099d434-5c90-4dfd-bf36-60dbb660140f with Priority: HIGHEST for action port [ 1076.880448] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_rules [ 1076.880664] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 1076.880711] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b099d434-5c90-4dfd-bf36-60dbb660140f with Priority: HIGHEST for action port [ 1076.880969] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.881247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.881318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.881561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.881701] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.884746] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.884916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.884916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.887163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.887163] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.887163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.887163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.887163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.887163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.887163] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.888276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-b099d434-5c90-4dfd-bf36-60dbb660140f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.888417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.888460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.888608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.888773] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b099d434-5c90-4dfd-bf36-60dbb660140f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.194791] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.195202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.195202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.195291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.195329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.195422] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1077.228673] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.228884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.228966] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.229217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.229366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.241316] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1077.386289] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.386289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.391873] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b099d434-5c90-4dfd-bf36-60dbb660140f with status ACTIVE [ 1077.391873] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.391873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.391873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.391873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.392328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.392328] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.392328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.392458] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.392856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.392856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.392856] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.393036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.393036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.393415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.393415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.393415] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b099d434-5c90-4dfd-bf36-60dbb660140f is going to be updated. [ 1077.395727] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.424272] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.424447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.424490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.424905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.425080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.425811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.547337] env[65992]: INFO networking_nsxv3.common.synchronization [req-a1a3638e-cd11-4b21-a7e1-636da7f7e41d req-6fbfc3b3-b036-43f1-adc5-d4522d476903 tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1077.548583] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1077.553027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.553027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.553027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.553027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.553027] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.553027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.553027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.553027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.553027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.553027] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.898853] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.908774] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.909056] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.909333] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.909469] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.909719] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.909870] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.909984] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.910210] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.910349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.910659] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.910764] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.910869] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.910976] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.911098] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.911204] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.911336] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.934410] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.934598] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.934911] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.935100] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-695" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.935416] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-2fd53ca6-a8d5-4167-9826-f0a536b34002 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.935595] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-2fd53ca6-a8d5-4167-9826-f0a536b34002" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.935701] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-2fd53ca6-a8d5-4167-9826-f0a536b34002" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.936123] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-2fd53ca6-a8d5-4167-9826-f0a536b34002" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.936272] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fd53ca6-a8d5-4167-9826-f0a536b34002',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.054745] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.054982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.054982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.055130] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.055203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.055443] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.055612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.055612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.055791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.055867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.055950] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1078.099754] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.100092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.100092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.100319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.100385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.124513] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1078.401555] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.402036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.402036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.402305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.402464] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.402616] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be created. [ 1078.439555] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.439835] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.440049] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.440378] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.440630] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.441409] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 2fd53ca6-a8d5-4167-9826-f0a536b34002 not found, creating... [ 1078.441409] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.441409] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.441653] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.441794] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.441983] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.442425] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.442622] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.442804] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.443079] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.443243] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.443444] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 2fd53ca6-a8d5-4167-9826-f0a536b34002 is going to be created. [ 1078.447044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.447044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.447044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.447044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.447044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.458830] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: UNINITIALIZED for 2s [ 1078.465594] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.465830] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.465922] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.466241] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.466494] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.466691] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-2fd53ca6-a8d5-4167-9826-f0a536b34002" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.621140] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1078.621140] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 deletion is rescheduled due to dependency. [ 1078.621140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.134722] env[65992]: INFO networking_nsxv3.common.synchronization [req-adc3f8ac-598c-490c-bfaa-3fe869a2f3b6 req-3bcc3c10-1665-416f-b2db-02445bc06a41 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_members [ 1079.135203] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 with Priority: HIGHEST for action security_group_members [ 1079.135535] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-579076b3-83ee-4ba4-9a58-7938062d1f76 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.135670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.135738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.136695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.136695] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.136695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.136695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.136695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.136695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.136695] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579076b3-83ee-4ba4-9a58-7938062d1f76',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.206891] env[65992]: INFO networking_nsxv3.common.synchronization [req-a1a3638e-cd11-4b21-a7e1-636da7f7e41d req-dd0afabf-5348-4d57-bd99-664e3a423d94 service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 1079.206891] env[65992]: INFO networking_nsxv3.common.synchronization [req-a1a3638e-cd11-4b21-a7e1-636da7f7e41d req-dd0afabf-5348-4d57-bd99-664e3a423d94 service nova] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1079.206891] env[65992]: INFO networking_nsxv3.common.synchronization [req-a1a3638e-cd11-4b21-a7e1-636da7f7e41d req-dd0afabf-5348-4d57-bd99-664e3a423d94 service nova] Enqueued Resource ID: 2fd53ca6-a8d5-4167-9826-f0a536b34002 with Priority: HIGHEST for action port [ 1079.209452] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_rules [ 1079.209830] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1079.210153] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fd53ca6-a8d5-4167-9826-f0a536b34002 with Priority: HIGHEST for action port [ 1079.210828] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.212954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.212954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.212954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.212954] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.214035] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.214782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.214782] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fd53ca6-a8d5-4167-9826-f0a536b34002 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.214782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fd53ca6-a8d5-4167-9826-f0a536b34002" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.214782] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fd53ca6-a8d5-4167-9826-f0a536b34002" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.216716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fd53ca6-a8d5-4167-9826-f0a536b34002" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.216716] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fd53ca6-a8d5-4167-9826-f0a536b34002',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.252431] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1079.252431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.640165] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.640668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.640668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.640781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.665239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.665597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.665730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.665791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.666009] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.666535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.666628] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 is going to be updated. [ 1079.698691] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.698949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.699040] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.699300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.699506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.708733] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 in Status: IN_PROGRESS for 2s [ 1079.717396] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.717506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.717732] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fd53ca6-a8d5-4167-9826-f0a536b34002 with status ACTIVE [ 1079.717909] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.718027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.718089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.718294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.718381] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.718576] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.718674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.718731] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.718886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.718960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.719166] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.719252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.719316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.719483] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.719630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.719630] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fd53ca6-a8d5-4167-9826-f0a536b34002 is going to be updated. [ 1079.747454] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.747454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.747454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.747454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.747454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.747454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fd53ca6-a8d5-4167-9826-f0a536b34002" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.135837] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1080.136103] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 1080.136265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.136463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.136882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.137107] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.137284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.137406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.137596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.137686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.137817] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.473896] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: SUCCESS [ 1080.473896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.473896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.473896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.474187] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.474676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.474676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.474734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.475440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.475828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.476352] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.640889] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.983022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.983022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.983022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.983022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.983275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.983352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.983496] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.983791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.983962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.984152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.984468] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.984622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.984694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.984914] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.986871] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.987326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.987326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.987326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.987326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.987717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.987717] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.143423] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.491661] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 724ff346-b8e9-4eb5-b30d-7bfeb697d754: rpc.has_security_group_logging(os_id): False [ 1081.509763] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.509913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.509982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.510206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.510291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.510512] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.510613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.510673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.510822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.510889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.511083] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.511179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.511261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.511371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.511441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.511617] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.511716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.511768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.511879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.511950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.512346] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be created. [ 1081.574564] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.574764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.574764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.574984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.575178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.587231] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: IN_PROGRESS for 2s [ 1081.645929] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.646313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.646313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.646442] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.646535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.646639] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1081.696397] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.696550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.696622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.696853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.696984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.708391] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1081.719608] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 in Status: SUCCESS [ 1081.719814] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579076b3-83ee-4ba4-9a58-7938062d1f76 deletion is rescheduled due to dependency. [ 1081.719981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579076b3-83ee-4ba4-9a58-7938062d1f76" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.604697] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: SUCCESS [ 1083.605045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.722325] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1083.722595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.723114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.723389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.723565] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.723654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.723684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.723870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.723959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.724060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.724176] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.211604] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1084.211738] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1084.227445] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.227599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.227665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.227876] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.228050] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.228142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.228202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.230036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.230036] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.230036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.230036] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.732891] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12a7f9db-1203-43be-8fe2-0b76907a767d: rpc.has_security_group_logging(os_id): False [ 1084.752022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.752022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.752022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.752022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.752585] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.752971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.753161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.753418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.753747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.753943] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1084.816948] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.819023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.819023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.819023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.819023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.841497] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1086.407570] env[65992]: INFO networking_nsxv3.common.synchronization [None req-992fd5fd-85ca-4267-8d41-37bf13821e3b None None] Enqueued Resource ID: b0c4ade9-1876-474d-a637-fbfe4c3961cf with Priority: HIGHEST for action port [ 1086.407984] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0c4ade9-1876-474d-a637-fbfe4c3961cf with Priority: HIGHEST for action port [ 1086.410884] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0c4ade9-1876-474d-a637-fbfe4c3961cf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.411032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0c4ade9-1876-474d-a637-fbfe4c3961cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.411694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0c4ade9-1876-474d-a637-fbfe4c3961cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.412132] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0c4ade9-1876-474d-a637-fbfe4c3961cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.412321] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c4ade9-1876-474d-a637-fbfe4c3961cf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.634812] env[65992]: INFO networking_nsxv3.common.synchronization [None req-b5a74f5f-e401-49fd-9b1d-76bf5d99395b tempest-ServersTestManualDisk-218777903 tempest-ServersTestManualDisk-218777903-project-member] Enqueued Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_rules [ 1086.634812] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_rules [ 1086.635667] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.635667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.635667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.636793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.636793] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.733837] env[65992]: INFO networking_nsxv3.common.synchronization [req-f60b4ebb-4d6f-4a8f-bd96-9f215fcfba52 req-454c046a-ae5e-4bbe-bafc-1378681be44e tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_members [ 1086.734318] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff with Priority: HIGHEST for action security_group_members [ 1086.734595] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.734781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.734862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.735080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.735241] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.735332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.735415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.735541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.735625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.735776] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7f9886e-09d8-4717-8a0d-1c46fb28d7ff',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.814238] env[65992]: INFO networking_nsxv3.common.synchronization [None req-a9c9519a-e756-4d59-b921-c87a4976c5b1 tempest-ServersTestManualDisk-218777903 tempest-ServersTestManualDisk-218777903-project-member] Enqueued Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_rules [ 1086.814862] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_rules [ 1086.815225] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.815328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.859759] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1086.859994] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.916023] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0c4ade9-1876-474d-a637-fbfe4c3961cf [ 1086.916023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.916023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.916023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.916023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.916023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.917953] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0c4ade9-1876-474d-a637-fbfe4c3961cf already deleted. [ 1086.918164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0c4ade9-1876-474d-a637-fbfe4c3961cf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.159452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.159452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.159452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.159664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.159721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.160053] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f already deleted. [ 1087.160053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.160053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.160184] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.160263] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.169259] env[65992]: INFO networking_nsxv3.common.synchronization [req-a638bd5e-e758-48cc-bdfd-c87ad8cf454f req-dfe7fe54-1404-484d-b3d8-aacca20b27d7 tempest-AttachVolumeShelveTestJSON-1466192988 tempest-AttachVolumeShelveTestJSON-1466192988-project-member] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_members [ 1087.169781] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGHEST for action security_group_members [ 1087.171252] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.173678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.173678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.173678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.173678] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.173678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.173678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.173678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.173678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.173678] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.238427] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.240139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.240139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.240139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.262249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.262511] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.262779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.262779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.262950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.262950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.263141] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff is going to be updated. [ 1087.294485] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.294485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.294485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.294485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.294485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.305689] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff in Status: IN_PROGRESS for 2s [ 1087.677094] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.677434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.677434] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.677551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.677722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.678261] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.678385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.678463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.678650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.678724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.678817] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a is going to be updated. [ 1087.693032] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.693189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.693262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.693485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.693571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.693675] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f already deleted. [ 1087.693784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.724898] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.725059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.725135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.725344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.725479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.736080] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: IN_PROGRESS for 2s [ 1088.757913] env[65992]: INFO networking_nsxv3.common.synchronization [req-5eed8b6e-3d15-4be7-95da-b3ba4118f08c req-dfc302a0-5bff-4890-8417-23cab431f5d8 tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 1088.758806] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGHEST for action security_group_members [ 1088.762604] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.762874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.762952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.763220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.763459] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.763603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.764176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.764176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.764176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.764176] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.810363] env[65992]: INFO networking_nsxv3.common.synchronization [req-5eed8b6e-3d15-4be7-95da-b3ba4118f08c req-dfc302a0-5bff-4890-8417-23cab431f5d8 tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: b099d434-5c90-4dfd-bf36-60dbb660140f with Priority: HIGHEST for action port [ 1088.810937] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b099d434-5c90-4dfd-bf36-60dbb660140f with Priority: HIGHEST for action port [ 1088.811276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-b099d434-5c90-4dfd-bf36-60dbb660140f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.811382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.811439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.811662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.811726] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b099d434-5c90-4dfd-bf36-60dbb660140f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.078445] env[65992]: INFO networking_nsxv3.common.synchronization [None req-69234cbf-aff8-48d1-b30b-dddc684c879a None None] Enqueued Resource ID: db86cac1-b295-4607-897e-3daee3fbac74 with Priority: HIGHEST for action port [ 1089.081186] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db86cac1-b295-4607-897e-3daee3fbac74 with Priority: HIGHEST for action port [ 1089.081609] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-db86cac1-b295-4607-897e-3daee3fbac74 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.081793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db86cac1-b295-4607-897e-3daee3fbac74" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.081917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db86cac1-b295-4607-897e-3daee3fbac74" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.082902] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db86cac1-b295-4607-897e-3daee3fbac74" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.082902] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db86cac1-b295-4607-897e-3daee3fbac74',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.267701] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.267852] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.267927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.268404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.268404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.268523] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.268523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.268625] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.268715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.268784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.268863] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be updated. [ 1089.298324] env[65992]: INFO networking_nsxv3.common.synchronization [None req-b19508f6-8a56-46fc-b20a-54420c383af0 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_rules [ 1089.299082] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_rules [ 1089.299422] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6743c98c-32bc-40d6-b15c-7a982090892d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.299801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.299801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.299987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.299987] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.309592] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.309727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.309823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.310024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.310168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.313564] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b099d434-5c90-4dfd-bf36-60dbb660140f with status ACTIVE [ 1089.313864] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.313947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.314057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.314297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.314380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.314560] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.314653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.314711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.314854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.314922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.315113] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.315550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.315550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.315550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.315550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.315550] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b099d434-5c90-4dfd-bf36-60dbb660140f is going to be updated. [ 1089.318927] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff in Status: SUCCESS [ 1089.319376] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7f9886e-09d8-4717-8a0d-1c46fb28d7ff deletion is rescheduled due to dependency. [ 1089.319490] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7f9886e-09d8-4717-8a0d-1c46fb28d7ff" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.320700] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: IN_PROGRESS for 2s [ 1089.353030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.353235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.353235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.353370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.353493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.353679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b099d434-5c90-4dfd-bf36-60dbb660140f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.467813] env[65992]: INFO networking_nsxv3.common.synchronization [req-b09d254c-717a-4215-83b9-ae70206f56d6 req-5089a144-8459-44ec-b54f-b9511985549d tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1089.468516] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1089.468946] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.469466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.469673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.470038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.470359] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.470514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.470664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.470863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.470958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.471067] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.559181] env[65992]: INFO networking_nsxv3.common.synchronization [None req-285c71c9-4dba-49c6-9ccf-8ec87075e1d5 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_rules [ 1089.559436] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_rules [ 1089.559741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6743c98c-32bc-40d6-b15c-7a982090892d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.559845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.584846] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db86cac1-b295-4607-897e-3daee3fbac74 [ 1089.585220] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.585406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.585499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.585775] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.585899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.586070] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db86cac1-b295-4607-897e-3daee3fbac74 already deleted. [ 1089.586205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db86cac1-b295-4607-897e-3daee3fbac74" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.747309] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85011876-1ce8-49d5-9b25-2c9588597a4a in Status: SUCCESS [ 1089.747506] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a deletion is rescheduled due to dependency. [ 1089.747621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.821445] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.821765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.821765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.822026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.822142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.822433] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6743c98c-32bc-40d6-b15c-7a982090892d already deleted. [ 1089.822433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.822580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.822828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.822950] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.831166] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.831352] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.831471] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.831715] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.831953] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.832121] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.832236] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.832435] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.832570] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.832776] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.832916] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.833070] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.833153] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.833271] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.833369] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.833501] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.852870] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.853143] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.853287] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.853460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-765" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.853832] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-030e4cda-c537-48a6-afdc-5b4da213395a taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.854029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-030e4cda-c537-48a6-afdc-5b4da213395a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.854173] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-030e4cda-c537-48a6-afdc-5b4da213395a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.854495] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-030e4cda-c537-48a6-afdc-5b4da213395a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.854635] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('030e4cda-c537-48a6-afdc-5b4da213395a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.976467] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.347034] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.347034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.347034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.347034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.347034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.347034] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6743c98c-32bc-40d6-b15c-7a982090892d already deleted. [ 1090.347322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.357323] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.357547] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.357660] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.357934] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.358144] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.358292] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 030e4cda-c537-48a6-afdc-5b4da213395a not found, creating... [ 1090.358481] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.358702] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.358832] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.359060] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.359199] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.359526] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.359768] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.359838] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.359990] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.360137] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.360272] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 030e4cda-c537-48a6-afdc-5b4da213395a is going to be created. [ 1090.382455] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.382694] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.382888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.383139] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.383386] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.383625] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-030e4cda-c537-48a6-afdc-5b4da213395a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.478581] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.981150] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.981431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.981431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.981685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.981784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.981903] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1091.017048] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.017048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.017048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.017048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.017048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.026228] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1091.215729] env[65992]: INFO networking_nsxv3.common.synchronization [req-b09d254c-717a-4215-83b9-ae70206f56d6 req-57ccba6b-b53a-4f60-8f38-7bf9feb4b573 service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 1091.215905] env[65992]: INFO networking_nsxv3.common.synchronization [req-b09d254c-717a-4215-83b9-ae70206f56d6 req-57ccba6b-b53a-4f60-8f38-7bf9feb4b573 service nova] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1091.216090] env[65992]: INFO networking_nsxv3.common.synchronization [req-b09d254c-717a-4215-83b9-ae70206f56d6 req-57ccba6b-b53a-4f60-8f38-7bf9feb4b573 service nova] Enqueued Resource ID: 030e4cda-c537-48a6-afdc-5b4da213395a with Priority: HIGHEST for action port [ 1091.217077] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_rules [ 1091.217077] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1091.217077] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 030e4cda-c537-48a6-afdc-5b4da213395a with Priority: HIGHEST for action port [ 1091.218792] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.218792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.218792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.219170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.219170] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.220362] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.220362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.220479] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-030e4cda-c537-48a6-afdc-5b4da213395a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.224595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-030e4cda-c537-48a6-afdc-5b4da213395a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.224595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-030e4cda-c537-48a6-afdc-5b4da213395a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.224595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-030e4cda-c537-48a6-afdc-5b4da213395a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.224595] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('030e4cda-c537-48a6-afdc-5b4da213395a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.353446] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 in Status: SUCCESS [ 1091.353748] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 deletion is rescheduled due to dependency. [ 1091.353911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.725659] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.725819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.728275] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 030e4cda-c537-48a6-afdc-5b4da213395a with status ACTIVE [ 1091.728499] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.728643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.728712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.728942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.729016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.729242] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.729589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.729589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.729805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.729805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.730053] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.730193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.730236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.730419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.730465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.730534] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 030e4cda-c537-48a6-afdc-5b4da213395a is going to be updated. [ 1091.755928] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.756108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.756166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.756744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.756744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.756744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-030e4cda-c537-48a6-afdc-5b4da213395a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.347808] env[65992]: INFO networking_nsxv3.common.synchronization [None req-255364c9-2c9f-4206-87c7-2af9dacca274 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_rules [ 1092.350094] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_rules [ 1092.350734] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.350873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.351700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.352160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.352160] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.455680] env[65992]: INFO networking_nsxv3.common.synchronization [None req-8bba64c0-2a59-4b4c-98ca-6b31227d66c6 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_rules [ 1092.457224] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_rules [ 1092.457599] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.457708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.876515] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.876657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.876726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.876972] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.877071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.877171] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b already deleted. [ 1092.877249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.877396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.877558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.877643] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.043285] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1093.043553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.043710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.044068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.044351] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.044478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.044478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.044628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.044748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.044748] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.399670] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.400256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.400256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.400372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.400471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.400572] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b already deleted. [ 1093.400768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.547704] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.051044] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.169453] env[65992]: INFO networking_nsxv3.common.synchronization [None req-3bf614d9-06e6-4e15-9142-c79b813bd037 tempest-ServerRescueNegativeTestJSON-1377566600 tempest-ServerRescueNegativeTestJSON-1377566600-project-member] Enqueued Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_rules [ 1094.173301] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_rules [ 1094.173301] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.173301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.173301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.173301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.173301] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.374797] env[65992]: INFO networking_nsxv3.common.synchronization [None req-8d465d75-c46c-4901-baa6-6ea7b78ae551 tempest-ServerRescueNegativeTestJSON-1377566600 tempest-ServerRescueNegativeTestJSON-1377566600-project-member] Enqueued Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_rules [ 1094.375705] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_rules [ 1094.376285] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.376443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.476103] env[65992]: INFO networking_nsxv3.common.synchronization [None req-40801be0-febb-4114-9ec4-ab42400ac0ee tempest-AttachVolumeShelveTestJSON-1466192988 tempest-AttachVolumeShelveTestJSON-1466192988-project-member] Enqueued Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_rules [ 1094.476951] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_rules [ 1094.481269] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.481269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.481269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.481269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.481269] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.553954] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.554160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.554240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.554472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.554572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.554674] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1094.585413] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.585711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.585794] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.586154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.586426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.599679] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1094.706319] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.706502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.706502] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.706773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.706862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.706963] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b already deleted. [ 1094.707060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.707215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.707371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.707454] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.753024] env[65992]: INFO networking_nsxv3.common.synchronization [req-c1a33ad7-9f65-4e11-908c-1b4d0a4fdb0f req-4f7b55a9-2e09-4e57-8db5-00efcdd9d2ee tempest-ServerDiskConfigTestJSON-1012109434 tempest-ServerDiskConfigTestJSON-1012109434-project-member] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1094.753024] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGHEST for action security_group_members [ 1094.753024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.753024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.753388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.753660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.753912] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.754070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.754177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.754660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.754784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.754901] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.915541] env[65992]: INFO networking_nsxv3.common.synchronization [None req-ee784a95-123c-4ba4-b0cd-2bc0d4db3596 tempest-AttachVolumeShelveTestJSON-1466192988 tempest-AttachVolumeShelveTestJSON-1466192988-project-member] Enqueued Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_rules [ 1094.915541] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_rules [ 1094.915892] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.915892] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.005926] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.005926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.005926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.005926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.005926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.005926] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb already deleted. [ 1095.006451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.006451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.006508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.006602] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.231171] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.231329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.231407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.231626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.231746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.231861] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b already deleted. [ 1095.231950] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.258736] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.259235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.259235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.259336] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.259445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.259616] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.259717] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.259779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.259938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.260034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.260135] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be updated. [ 1095.305205] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.305477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.305477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.305615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.305754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.316174] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: IN_PROGRESS for 2s [ 1095.531999] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.532284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.532322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.532556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.532682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.532838] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb already deleted. [ 1095.532943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.668925] env[65992]: INFO networking_nsxv3.common.synchronization [req-f9f326cd-077c-44a3-bc10-0ebc5abf955f req-c2676c07-3e17-4982-80bb-b3435588d73c tempest-ServersTestManualDisk-218777903 tempest-ServersTestManualDisk-218777903-project-member] Enqueued Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_members [ 1095.669487] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_members [ 1095.669863] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.670018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.670090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.670379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.670558] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.670711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.670785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.670952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.671047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.671140] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.013564] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.013564] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-865" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.013564] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-865" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.013823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-865" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.013988] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.014400] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.014522] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.015365] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.015365] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.015365] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.015365] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.015365] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.015576] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.015576] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.015633] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.015741] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.047404] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.047404] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.047404] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.047404] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-865" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.047404] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-7afb54bc-8069-485d-929a-89adaf87946a taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.047404] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-7afb54bc-8069-485d-929a-89adaf87946a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.047404] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-7afb54bc-8069-485d-929a-89adaf87946a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.049622] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-7afb54bc-8069-485d-929a-89adaf87946a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.051314] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7afb54bc-8069-485d-929a-89adaf87946a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.173480] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.173559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.173559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.173851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.173974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.174304] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.174366] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.174395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.177991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.177991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.177991] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f already deleted. [ 1096.177991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.544848] env[65992]: INFO networking_nsxv3.common.synchronization [req-7e3183ab-01c8-48d4-9116-8f949e252c10 req-aad94e79-15a6-4a66-869a-0df9185d6cf8 tempest-AttachVolumeTestJSON-243931194 tempest-AttachVolumeTestJSON-243931194-project-member] Enqueued Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_members [ 1096.545617] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 with Priority: HIGHEST for action security_group_members [ 1096.545850] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.545986] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.546089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.546262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.546473] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.546612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.546678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.546848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.546991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.547075] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9ae5db7-375e-4a37-a1a9-1b791ce8df64',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.559401] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.559638] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.559799] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.560149] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.560326] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.560487] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 7afb54bc-8069-485d-929a-89adaf87946a not found, creating... [ 1096.560837] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.561031] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.561155] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.561392] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.561523] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.562235] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.562413] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.562529] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.562735] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.562867] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.563013] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 7afb54bc-8069-485d-929a-89adaf87946a is going to be created. [ 1096.590183] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.590502] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.590763] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.591188] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.591548] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.591887] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-7afb54bc-8069-485d-929a-89adaf87946a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.609745] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1096.609962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.611058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.611058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.611058] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.611058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.611058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.611058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.611058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.611058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.611503] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.051535] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.051644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.051720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.052689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.082463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.082463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.082463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.082463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.082463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.082463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.082463] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 is going to be updated. [ 1097.116024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.116024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.116024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.116024] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.116024] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.116683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.116683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.116683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.116683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.116683] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.118554] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.118987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.119167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.119427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.119674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.131245] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 in Status: IN_PROGRESS for 2s [ 1097.316663] env[65992]: INFO networking_nsxv3.common.synchronization [req-f9f326cd-077c-44a3-bc10-0ebc5abf955f req-9baff1f8-1e1f-4fed-9355-462de8f55d50 service nova] Enqueued Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_rules [ 1097.317214] env[65992]: INFO networking_nsxv3.common.synchronization [req-f9f326cd-077c-44a3-bc10-0ebc5abf955f req-9baff1f8-1e1f-4fed-9355-462de8f55d50 service nova] Enqueued Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_members [ 1097.320139] env[65992]: INFO networking_nsxv3.common.synchronization [req-f9f326cd-077c-44a3-bc10-0ebc5abf955f req-9baff1f8-1e1f-4fed-9355-462de8f55d50 service nova] Enqueued Resource ID: 7afb54bc-8069-485d-929a-89adaf87946a with Priority: HIGHEST for action port [ 1097.321631] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_rules [ 1097.321815] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_members [ 1097.321962] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7afb54bc-8069-485d-929a-89adaf87946a with Priority: HIGHEST for action port [ 1097.322302] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.322430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.322495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.322708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.322848] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.323932] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.324036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.324136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.324370] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.324527] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.324624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.324686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.324878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.324922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.325046] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.326091] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-7afb54bc-8069-485d-929a-89adaf87946a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.326091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7afb54bc-8069-485d-929a-89adaf87946a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.326091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7afb54bc-8069-485d-929a-89adaf87946a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.326202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7afb54bc-8069-485d-929a-89adaf87946a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.326239] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7afb54bc-8069-485d-929a-89adaf87946a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.344466] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12a7f9db-1203-43be-8fe2-0b76907a767d in Status: SUCCESS [ 1097.344466] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d deletion is rescheduled due to dependency. [ 1097.346076] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.622362] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6417014f-241b-4b36-8b7b-aeef9e200013: rpc.has_security_group_logging(os_id): False [ 1097.645520] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.645672] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.645741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.645960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.646061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.646292] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.646385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.646436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.647277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.647277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.647277] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.647277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.647277] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.648153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.648399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.648684] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.648809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.649560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.649560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.649560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.649560] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1097.714152] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.714978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.714978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.714978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.714978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.732770] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1097.833992] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.833992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.835988] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.836538] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7afb54bc-8069-485d-929a-89adaf87946a with status ACTIVE [ 1097.836538] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.836682] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.836721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.836931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.837030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.837203] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.837299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.837358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.837513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.837587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.837770] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.837863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.837924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.838419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.838807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.838939] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7afb54bc-8069-485d-929a-89adaf87946a is going to be updated. [ 1097.862856] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.863083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.863188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.863432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.863607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.863804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7afb54bc-8069-485d-929a-89adaf87946a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.341533] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.844278] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.844573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.844573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.844725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.844810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.844906] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f is going to be created. [ 1098.873033] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.873033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.873033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.873261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.873412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.885100] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f in Status: UNINITIALIZED for 2s [ 1099.143811] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 in Status: SUCCESS [ 1099.144059] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9ae5db7-375e-4a37-a1a9-1b791ce8df64 deletion is rescheduled due to dependency. [ 1099.144145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9ae5db7-375e-4a37-a1a9-1b791ce8df64" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.750970] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1099.752102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.212540] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2ba9de6-c672-4256-935a-3fb32c6bca80 req-7b414d51-5539-4e9d-94b3-e7615e4ab080 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_members [ 1100.213132] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_members [ 1100.213452] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6743c98c-32bc-40d6-b15c-7a982090892d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.213576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.213641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.213900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.214065] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.214168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.214229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.214379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.214457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.214541] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.574225] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.574522] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.574651] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.575085] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.575371] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.575525] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.575640] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.575870] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.576033] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.576239] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.576345] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.576448] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.576547] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.576648] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.576747] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.576870] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.598035] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.598035] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.598035] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.598264] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.598534] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-a428bd34-9cf3-4399-9177-b631bd26a332 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.598741] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-a428bd34-9cf3-4399-9177-b631bd26a332" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.598878] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-a428bd34-9cf3-4399-9177-b631bd26a332" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.599246] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-a428bd34-9cf3-4399-9177-b631bd26a332" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.599384] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a428bd34-9cf3-4399-9177-b631bd26a332',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.717048] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.717211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.717211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.717414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.717497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.717688] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.717781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.717927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.718068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.718159] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.718245] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6743c98c-32bc-40d6-b15c-7a982090892d already deleted. [ 1100.718330] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.896189] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f in Status: SUCCESS [ 1100.896412] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.896574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.896812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.897075] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.897133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.897216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.897351] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.897485] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.897548] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.897637] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.101528] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.101790] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.102238] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.102671] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.102913] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.103268] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port a428bd34-9cf3-4399-9177-b631bd26a332 not found, creating... [ 1101.103610] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.103789] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.103909] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.104184] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.104397] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.104850] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.105122] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.105330] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.105640] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.105864] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.106144] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: a428bd34-9cf3-4399-9177-b631bd26a332 is going to be created. [ 1101.126484] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.126721] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.126866] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.127169] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.127401] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.127620] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-a428bd34-9cf3-4399-9177-b631bd26a332" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.259159] env[65992]: INFO networking_nsxv3.common.synchronization [req-e23c3a23-762c-47a8-b6e9-0223c633d8cf req-99f711ca-b6a4-4085-a5cc-c4efab01a358 tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1101.259886] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1101.260275] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.260400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.260451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.260685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.260925] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.261056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.261120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.261287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.261372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.261467] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.400118] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.765322] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.765322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.765322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.765322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.785217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.785474] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.785592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.785655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.785886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.785979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.786067] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1101.815332] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.815332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.815332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.815332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.815332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.824923] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1101.840491] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2ba9de6-c672-4256-935a-3fb32c6bca80 req-8d087f77-28df-409d-887e-a481e59c602e service nova] Enqueued Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_rules [ 1101.841711] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2ba9de6-c672-4256-935a-3fb32c6bca80 req-8d087f77-28df-409d-887e-a481e59c602e service nova] Enqueued Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_members [ 1101.841711] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2ba9de6-c672-4256-935a-3fb32c6bca80 req-8d087f77-28df-409d-887e-a481e59c602e service nova] Enqueued Resource ID: a428bd34-9cf3-4399-9177-b631bd26a332 with Priority: HIGHEST for action port [ 1101.841711] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_rules [ 1101.841711] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_members [ 1101.842217] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a428bd34-9cf3-4399-9177-b631bd26a332 with Priority: HIGHEST for action port [ 1101.842713] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6743c98c-32bc-40d6-b15c-7a982090892d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.842938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.844029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.844029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.844029] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.844312] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6743c98c-32bc-40d6-b15c-7a982090892d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.844401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.844401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.844572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.844718] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.844814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.844875] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.845018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.845108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.845226] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.847080] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a428bd34-9cf3-4399-9177-b631bd26a332 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.847244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a428bd34-9cf3-4399-9177-b631bd26a332" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.847328] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a428bd34-9cf3-4399-9177-b631bd26a332" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.847515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a428bd34-9cf3-4399-9177-b631bd26a332" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.847593] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a428bd34-9cf3-4399-9177-b631bd26a332',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.904828] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed0b38e7-705e-40dd-972f-3a9d14a5f23f: rpc.has_security_group_logging(os_id): False [ 1101.927291] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.927554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.927646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.927954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.928140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.928541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.928760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.928817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.929105] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.929768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.929768] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f is going to be created. [ 1101.998205] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.998525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.998936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.999455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.999569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.015502] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f in Status: IN_PROGRESS for 2s [ 1102.350070] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6743c98c-32bc-40d6-b15c-7a982090892d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.350070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.350401] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.352275] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a428bd34-9cf3-4399-9177-b631bd26a332 with status ACTIVE [ 1102.352496] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.353451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.353451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.353451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.353451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.353451] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.353451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.353451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.353817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.353817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.353873] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.354052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.354052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.354153] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.354196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.354285] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a428bd34-9cf3-4399-9177-b631bd26a332 is going to be updated. [ 1102.385958] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.386130] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.386203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.386417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.386551] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.386709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a428bd34-9cf3-4399-9177-b631bd26a332" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.675390] env[65992]: INFO networking_nsxv3.common.synchronization [req-ebcdf7c7-4f9a-40ce-8acb-ce95a7200690 req-489e51d5-c428-4784-bcd1-182b73a8a8b2 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_members [ 1102.675947] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_members [ 1102.676298] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.676419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.676486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.676735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.676890] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.676988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.677060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.677207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.677290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.677420] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.858977] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.994926] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.994926] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.994926] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.994926] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.994926] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.995749] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.996508] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.996846] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.997123] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.997699] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.998122] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.999023] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.999023] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.999023] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.999023] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.999352] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.021506] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.021993] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1103.024084] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.024084] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.024084] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-69fcda0f-8944-4628-b6c1-05821a17a85a taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.024084] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-69fcda0f-8944-4628-b6c1-05821a17a85a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.024084] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-69fcda0f-8944-4628-b6c1-05821a17a85a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.024084] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-69fcda0f-8944-4628-b6c1-05821a17a85a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.024084] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69fcda0f-8944-4628-b6c1-05821a17a85a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.179407] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.179581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.179634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.179849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.179949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.180546] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.180546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.180546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.180546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.180546] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.180546] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b already deleted. [ 1103.180944] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.362045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.362734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.362734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.362734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.362734] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.362734] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6743c98c-32bc-40d6-b15c-7a982090892d is going to be created. [ 1103.389028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.389028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.389028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.389281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.389408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.400168] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6743c98c-32bc-40d6-b15c-7a982090892d in Status: UNINITIALIZED for 2s [ 1103.526809] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.527122] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.527309] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.527778] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.527881] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.528099] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 69fcda0f-8944-4628-b6c1-05821a17a85a not found, creating... [ 1103.528472] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.528683] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.528855] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.529176] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.529368] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.529770] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.529987] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.530170] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.530449] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.530636] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.530895] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 69fcda0f-8944-4628-b6c1-05821a17a85a is going to be created. [ 1103.552799] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.553131] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.553276] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.553633] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.553941] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.554252] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-69fcda0f-8944-4628-b6c1-05821a17a85a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.835341] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1103.835439] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 deletion is rescheduled due to dependency. [ 1103.835559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.030986] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f in Status: SUCCESS [ 1104.031266] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.259345] env[65992]: INFO networking_nsxv3.common.synchronization [req-ebcdf7c7-4f9a-40ce-8acb-ce95a7200690 req-70502520-c856-4993-919a-820c4c8b4c7b service nova] Enqueued Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_rules [ 1104.259345] env[65992]: INFO networking_nsxv3.common.synchronization [req-ebcdf7c7-4f9a-40ce-8acb-ce95a7200690 req-70502520-c856-4993-919a-820c4c8b4c7b service nova] Enqueued Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_members [ 1104.259345] env[65992]: INFO networking_nsxv3.common.synchronization [req-ebcdf7c7-4f9a-40ce-8acb-ce95a7200690 req-70502520-c856-4993-919a-820c4c8b4c7b service nova] Enqueued Resource ID: 69fcda0f-8944-4628-b6c1-05821a17a85a with Priority: HIGHEST for action port [ 1104.260510] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_rules [ 1104.264022] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_members [ 1104.264022] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69fcda0f-8944-4628-b6c1-05821a17a85a with Priority: HIGHEST for action port [ 1104.264022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.264022] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.264022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.264022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.264022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.264022] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.265874] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-69fcda0f-8944-4628-b6c1-05821a17a85a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.266463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69fcda0f-8944-4628-b6c1-05821a17a85a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.266648] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69fcda0f-8944-4628-b6c1-05821a17a85a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.266912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69fcda0f-8944-4628-b6c1-05821a17a85a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.268791] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69fcda0f-8944-4628-b6c1-05821a17a85a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.770660] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.771043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.771132] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.772185] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69fcda0f-8944-4628-b6c1-05821a17a85a with status ACTIVE [ 1104.772356] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.773030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.773030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.773030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.773030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.773030] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.773299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.773299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.773353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.773428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.773601] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.773726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.773780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.773890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.773965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.774065] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69fcda0f-8944-4628-b6c1-05821a17a85a is going to be updated. [ 1104.798283] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.798283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.798283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.798283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.798283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.798585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69fcda0f-8944-4628-b6c1-05821a17a85a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.277130] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.411778] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6743c98c-32bc-40d6-b15c-7a982090892d in Status: SUCCESS [ 1105.412545] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.413256] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.415017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.415017] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.415017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.415017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.415017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.415017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.415017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.416485] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.642445] env[65992]: INFO networking_nsxv3.common.synchronization [req-e7dc08c1-085b-4412-972d-347802199875 req-409a99d0-4fce-473b-9c9a-6a6824557345 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1105.642445] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1105.643041] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.643495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.643689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.644099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.644410] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.645976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.645976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.645976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.645976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.645976] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.779406] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.779824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.779824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.779824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.779979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.780036] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b is going to be created. [ 1105.807196] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.807363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.807455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.807632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.807790] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.817787] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b in Status: UNINITIALIZED for 2s [ 1105.919320] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.151506] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.421684] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6743c98c-32bc-40d6-b15c-7a982090892d: rpc.has_security_group_logging(os_id): False [ 1106.447431] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.447538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.447615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.448367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.448367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.448632] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.448632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.448807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.448915] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.449018] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.449191] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6743c98c-32bc-40d6-b15c-7a982090892d is going to be created. [ 1106.529941] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.530478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.530478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.530598] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.530675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.542849] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6743c98c-32bc-40d6-b15c-7a982090892d in Status: IN_PROGRESS for 2s [ 1106.654076] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.905342] env[65992]: INFO networking_nsxv3.common.synchronization [req-b368f7ce-2346-4dd7-88f6-cb756e12f13b req-462adcff-142e-4ce3-9d72-e2092f55b300 tempest-ServerRescueNegativeTestJSON-1377566600 tempest-ServerRescueNegativeTestJSON-1377566600-project-member] Enqueued Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_members [ 1106.905919] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_members [ 1106.906360] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b680f30c-1e44-4a84-83f2-ddbc61e8000b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.906475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.906475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.906701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.906989] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.906989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.907154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.907305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.907388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.907480] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.156786] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.156954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.157047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.157359] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.157471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.157602] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1107.193510] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.193709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.194180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.194180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.194180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.205248] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1107.322317] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.322576] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.322719] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.322988] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.323274] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.323433] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.323545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.324554] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.324842] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.325599] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.325762] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.326176] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.326694] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.326873] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.327384] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.328024] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.348495] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.348705] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.348863] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.349069] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-130" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.349422] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-2598d117-fce4-41d2-9391-1426aa5b3dbc taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.349625] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-2598d117-fce4-41d2-9391-1426aa5b3dbc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.349757] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-2598d117-fce4-41d2-9391-1426aa5b3dbc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.350106] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-2598d117-fce4-41d2-9391-1426aa5b3dbc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.350244] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2598d117-fce4-41d2-9391-1426aa5b3dbc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.411820] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.411820] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.411820] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b already deleted. [ 1107.411820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.828238] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b in Status: SUCCESS [ 1107.828450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.828624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.828890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.829140] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.829363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.829363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.829596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.829712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.829783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.829909] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.852951] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.853280] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.853412] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.853743] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.853949] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.854153] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 2598d117-fce4-41d2-9391-1426aa5b3dbc not found, creating... [ 1107.854468] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.854660] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.854794] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.855056] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.855217] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.855569] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.855755] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.855888] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.856228] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.856470] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.856640] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 2598d117-fce4-41d2-9391-1426aa5b3dbc is going to be created. [ 1107.875906] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.876180] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.876287] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.876599] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.876779] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.876998] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-2598d117-fce4-41d2-9391-1426aa5b3dbc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.332365] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.560260] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6743c98c-32bc-40d6-b15c-7a982090892d in Status: SUCCESS [ 1108.560260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.634763] env[65992]: INFO networking_nsxv3.common.synchronization [req-b368f7ce-2346-4dd7-88f6-cb756e12f13b req-28b50161-08f4-4175-9053-f98218f14ddf service nova] Enqueued Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_rules [ 1108.634986] env[65992]: INFO networking_nsxv3.common.synchronization [req-b368f7ce-2346-4dd7-88f6-cb756e12f13b req-28b50161-08f4-4175-9053-f98218f14ddf service nova] Enqueued Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_members [ 1108.635192] env[65992]: INFO networking_nsxv3.common.synchronization [req-b368f7ce-2346-4dd7-88f6-cb756e12f13b req-28b50161-08f4-4175-9053-f98218f14ddf service nova] Enqueued Resource ID: 2598d117-fce4-41d2-9391-1426aa5b3dbc with Priority: HIGHEST for action port [ 1108.635854] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_rules [ 1108.636173] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_members [ 1108.636287] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2598d117-fce4-41d2-9391-1426aa5b3dbc with Priority: HIGHEST for action port [ 1108.636562] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.636711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.636797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.637718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.637845] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.638833] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b680f30c-1e44-4a84-83f2-ddbc61e8000b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.638955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.639091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.639309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.639501] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.639628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.639708] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.639929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.639929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.640103] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.641133] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2598d117-fce4-41d2-9391-1426aa5b3dbc taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.641133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2598d117-fce4-41d2-9391-1426aa5b3dbc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.641133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2598d117-fce4-41d2-9391-1426aa5b3dbc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.641394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2598d117-fce4-41d2-9391-1426aa5b3dbc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.641506] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2598d117-fce4-41d2-9391-1426aa5b3dbc',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.836045] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b: rpc.has_security_group_logging(os_id): False [ 1108.855400] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.855569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.855610] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.855844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.855936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.856246] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.856388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.856440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.856572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.856888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.856888] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b is going to be created. [ 1108.916624] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.916624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.916624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.916820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.916907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.928081] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b in Status: IN_PROGRESS for 2s [ 1109.143857] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.145776] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b680f30c-1e44-4a84-83f2-ddbc61e8000b taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.145776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.145776] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2598d117-fce4-41d2-9391-1426aa5b3dbc with status ACTIVE [ 1109.146082] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.146826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.146826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.146826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.146826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.146981] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.146981] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.147113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.148221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.148221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.148221] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.148221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.148221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.148221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.148221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.148221] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2598d117-fce4-41d2-9391-1426aa5b3dbc is going to be updated. [ 1109.171413] env[65992]: INFO networking_nsxv3.common.synchronization [None req-64fb9319-ad5c-417e-a0f8-1d2e81192aea tempest-AttachVolumeTestJSON-243931194 tempest-AttachVolumeTestJSON-243931194-project-member] Enqueued Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_rules [ 1109.172362] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_rules [ 1109.173306] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.173446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.173514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.173716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.173851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.174073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2598d117-fce4-41d2-9391-1426aa5b3dbc" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.174477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763682a6-c9f9-4906-bec2-c14372760919 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.174637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.174637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.174811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.174919] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.217586] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 4s [ 1109.262624] env[65992]: INFO networking_nsxv3.common.synchronization [None req-7eba4339-5eb4-483e-b2c3-3fed3ccd023c tempest-AttachVolumeTestJSON-243931194 tempest-AttachVolumeTestJSON-243931194-project-member] Enqueued Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_rules [ 1109.264638] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_rules [ 1109.264638] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763682a6-c9f9-4906-bec2-c14372760919 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.264638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.647248] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.697385] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.697543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.697614] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.697869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.697964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.698076] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763682a6-c9f9-4906-bec2-c14372760919 already deleted. [ 1109.698161] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.698452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.698665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.698792] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.151113] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.151113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.151113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.152877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.152977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.153133] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b is going to be created. [ 1110.179475] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.179626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.179727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.179998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.180168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.190277] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b in Status: UNINITIALIZED for 2s [ 1110.226458] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.226604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.226673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.226888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.226976] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.227086] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763682a6-c9f9-4906-bec2-c14372760919 already deleted. [ 1110.227168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.944861] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b in Status: SUCCESS [ 1110.945204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.147793] env[65992]: INFO networking_nsxv3.common.synchronization [req-d70f73b4-e786-4713-a4be-2f97d5472cf6 req-c8e689f9-36f8-4274-a945-3ffd98811846 tempest-AttachVolumeShelveTestJSON-1466192988 tempest-AttachVolumeShelveTestJSON-1466192988-project-member] Enqueued Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_members [ 1111.148641] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_members [ 1111.149380] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.149562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.149650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.149985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.150202] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.150307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.150375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.150577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.150736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.150879] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.231288] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1111.231513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.601801] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.602038] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.602170] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.602456] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.602708] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.602867] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.604610] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.604995] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.605211] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.605477] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.605602] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.605761] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.605974] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.606172] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.606360] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.606562] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.630026] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.630026] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.630026] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.630026] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.630301] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-c2e6cb5f-e08e-4f00-ae08-def75538b547 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.630301] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.630406] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.630742] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.630875] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2e6cb5f-e08e-4f00-ae08-def75538b547',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.654737] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.654965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.654965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.655237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.655326] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.655522] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.655628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.655689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.655884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.656071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.656178] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb already deleted. [ 1111.656178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.135461] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.135860] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.136055] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.136545] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.136797] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.137066] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port c2e6cb5f-e08e-4f00-ae08-def75538b547 not found, creating... [ 1112.137522] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.137792] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.137989] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.138364] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.138594] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.139141] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.139345] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.139470] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.139730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.139878] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.140043] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: c2e6cb5f-e08e-4f00-ae08-def75538b547 is going to be created. [ 1112.163378] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.163628] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.163723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.164127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.164422] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.164989] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.201711] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b in Status: SUCCESS [ 1112.202065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.202323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.202558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.202754] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.202874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.202944] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.203160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.203268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.203380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.203471] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.706249] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.948514] env[65992]: INFO networking_nsxv3.common.synchronization [req-d70f73b4-e786-4713-a4be-2f97d5472cf6 req-8998c479-b41a-4781-bdb6-e059d2575a09 service nova] Enqueued Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_rules [ 1112.948639] env[65992]: INFO networking_nsxv3.common.synchronization [req-d70f73b4-e786-4713-a4be-2f97d5472cf6 req-8998c479-b41a-4781-bdb6-e059d2575a09 service nova] Enqueued Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_members [ 1112.948783] env[65992]: INFO networking_nsxv3.common.synchronization [req-d70f73b4-e786-4713-a4be-2f97d5472cf6 req-8998c479-b41a-4781-bdb6-e059d2575a09 service nova] Enqueued Resource ID: c2e6cb5f-e08e-4f00-ae08-def75538b547 with Priority: HIGHEST for action port [ 1112.949395] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_rules [ 1112.949532] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_members [ 1112.949627] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2e6cb5f-e08e-4f00-ae08-def75538b547 with Priority: HIGHEST for action port [ 1112.949953] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.951525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.951663] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.951954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.952484] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.953449] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.954906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.955081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.958513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.959824] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.959998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.960449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.960665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.960762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.960871] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.962093] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2e6cb5f-e08e-4f00-ae08-def75538b547 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.962093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.962207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.962375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.962481] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2e6cb5f-e08e-4f00-ae08-def75538b547',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.208664] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b680f30c-1e44-4a84-83f2-ddbc61e8000b: rpc.has_security_group_logging(os_id): False [ 1113.244595] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.244762] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.244858] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.245022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.245167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.245427] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.245572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.245572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.245755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.245848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.245923] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b is going to be created. [ 1113.319156] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.319156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.320684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.320684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.320684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.343023] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b in Status: IN_PROGRESS for 2s [ 1113.464411] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.464644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.464940] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.465975] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2e6cb5f-e08e-4f00-ae08-def75538b547 with status ACTIVE [ 1113.466262] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.466390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.466469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.466684] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.466773] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.466964] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.467074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.467135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.468531] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.468755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.468994] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.469119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.469182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.469341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.469417] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.469509] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2e6cb5f-e08e-4f00-ae08-def75538b547 is going to be updated. [ 1113.491395] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.492186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.492186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.492349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.493020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.493020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.972059] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.475022] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.475022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.475022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.475022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.475488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.475488] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb is going to be created. [ 1114.520382] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.520382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.520382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.520649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.520649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.535428] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: UNINITIALIZED for 2s [ 1115.299652] env[65992]: INFO networking_nsxv3.common.synchronization [req-2441ecf8-77d0-4e65-a598-c0c54261a1c4 req-01fcb6c3-19ec-4988-98ce-0516bd3d17f9 tempest-ServersTestJSON-1639363980 tempest-ServersTestJSON-1639363980-project-member] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1115.301081] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGHEST for action security_group_members [ 1115.301081] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.301081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.301081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.301368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.301463] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.301526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.301585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.301743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.301826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.301929] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.359611] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b in Status: SUCCESS [ 1115.359873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.804218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.804601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.804601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.804709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.804709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.804900] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.805012] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.805074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.805227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.805300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.805393] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be updated. [ 1115.833487] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.833650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.833724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.833955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.834129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.843977] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: IN_PROGRESS for 2s [ 1116.547112] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: SUCCESS [ 1116.547410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.547605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.547853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.548083] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.548205] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.548269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.548457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.548549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.548635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.548724] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.051043] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.552587] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b680e30-6d7d-4efa-b160-f9820a859bcb: rpc.has_security_group_logging(os_id): False [ 1117.574829] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.575032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.575118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.575371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.575488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.575771] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.575909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.575987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.576209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.576305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.576417] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb is going to be created. [ 1117.659757] env[65992]: INFO networking_nsxv3.common.synchronization [req-e12e4c7f-ef43-4611-bd27-79c0eb32db3c req-94a9bb12-5b48-4ae9-837c-998ce593e4f1 tempest-AttachVolumeTestJSON-243931194 tempest-AttachVolumeTestJSON-243931194-project-member] Enqueued Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_members [ 1117.659757] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_members [ 1117.659757] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763682a6-c9f9-4906-bec2-c14372760919 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.659757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.659757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.660307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.660490] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.660622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.660743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.661197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.661197] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.661296] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.683586] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.683742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.683798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.684414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.684414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.700067] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: IN_PROGRESS for 2s [ 1117.854360] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6417014f-241b-4b36-8b7b-aeef9e200013 in Status: SUCCESS [ 1117.854739] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 deletion is rescheduled due to dependency. [ 1117.854739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.037221] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.037419] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-774" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.037536] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-774" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.037806] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-774" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.038079] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.038240] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.038357] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.038574] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.038724] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.038952] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.039129] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.039301] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.039472] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.039604] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.039716] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.039846] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.065251] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.065251] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.065251] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.065251] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-774" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.065251] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-a44a563c-8b03-490f-8528-920220c1c8bd taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.065251] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-a44a563c-8b03-490f-8528-920220c1c8bd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.065251] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-a44a563c-8b03-490f-8528-920220c1c8bd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.065251] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-a44a563c-8b03-490f-8528-920220c1c8bd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.065251] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a44a563c-8b03-490f-8528-920220c1c8bd',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.164661] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.164821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.164894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.165155] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.165213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.165406] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.165510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.165572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.165718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.165791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.165874] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763682a6-c9f9-4906-bec2-c14372760919 already deleted. [ 1118.165955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.567685] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.567963] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.568134] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.568449] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.568642] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.568831] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port a44a563c-8b03-490f-8528-920220c1c8bd not found, creating... [ 1118.569225] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.569327] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.569433] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.569681] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.569838] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.570180] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.570370] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.570517] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.570754] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.570934] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.571159] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: a44a563c-8b03-490f-8528-920220c1c8bd is going to be created. [ 1118.590918] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.591214] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.591323] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.591630] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.591956] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.592255] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-a44a563c-8b03-490f-8528-920220c1c8bd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.332548] env[65992]: INFO networking_nsxv3.common.synchronization [req-e12e4c7f-ef43-4611-bd27-79c0eb32db3c req-2705bbfb-bd1d-4074-95f3-62e9d9fa25de service nova] Enqueued Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_rules [ 1119.332798] env[65992]: INFO networking_nsxv3.common.synchronization [req-e12e4c7f-ef43-4611-bd27-79c0eb32db3c req-2705bbfb-bd1d-4074-95f3-62e9d9fa25de service nova] Enqueued Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_members [ 1119.332798] env[65992]: INFO networking_nsxv3.common.synchronization [req-e12e4c7f-ef43-4611-bd27-79c0eb32db3c req-2705bbfb-bd1d-4074-95f3-62e9d9fa25de service nova] Enqueued Resource ID: a44a563c-8b03-490f-8528-920220c1c8bd with Priority: HIGHEST for action port [ 1119.333377] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_rules [ 1119.333498] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_members [ 1119.333595] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a44a563c-8b03-490f-8528-920220c1c8bd with Priority: HIGHEST for action port [ 1119.333863] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763682a6-c9f9-4906-bec2-c14372760919 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.333985] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.334079] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.334389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.334523] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.336133] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763682a6-c9f9-4906-bec2-c14372760919 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.336234] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.336280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.336555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.336789] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.336924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.337030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.337288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.337428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.337571] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.339282] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a44a563c-8b03-490f-8528-920220c1c8bd taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.339452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a44a563c-8b03-490f-8528-920220c1c8bd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.339581] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a44a563c-8b03-490f-8528-920220c1c8bd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.339939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a44a563c-8b03-490f-8528-920220c1c8bd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.340082] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a44a563c-8b03-490f-8528-920220c1c8bd',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.713942] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: SUCCESS [ 1119.714219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.836726] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763682a6-c9f9-4906-bec2-c14372760919 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.836947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.842423] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.843558] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a44a563c-8b03-490f-8528-920220c1c8bd with status ACTIVE [ 1119.843691] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.843874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.843980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.844308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.844383] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.844573] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.844680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.844737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.844894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.844967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.845165] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.845261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.845323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.845463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.845536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.845690] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a44a563c-8b03-490f-8528-920220c1c8bd is going to be updated. [ 1119.872056] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.872217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.872287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.872500] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.872634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.872800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a44a563c-8b03-490f-8528-920220c1c8bd" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.958283] env[65992]: INFO networking_nsxv3.common.synchronization [req-c3d27a3c-b8c6-4626-aba3-357411cd1f75 req-5d003ea4-e3fe-4148-a98e-888a2cd3d31f tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 1119.959157] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 1119.959620] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.959802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.959916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.960386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.960882] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.961164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.961295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.961510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.961630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.961746] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.277031] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.277031] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.277031] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.277318] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.277472] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.277639] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.277753] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.278476] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.278675] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.278893] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.279060] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.279164] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.279274] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.279385] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.279491] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.279620] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.299798] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.299946] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.300103] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.300322] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-629" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.301022] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-aa9d8557-c16c-408d-83d4-2578f1fd2a60 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.301022] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-aa9d8557-c16c-408d-83d4-2578f1fd2a60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.301022] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-aa9d8557-c16c-408d-83d4-2578f1fd2a60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.301380] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-aa9d8557-c16c-408d-83d4-2578f1fd2a60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.301518] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa9d8557-c16c-408d-83d4-2578f1fd2a60',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.348028] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.463571] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.804742] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.805096] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.805287] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.805654] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.805840] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.806094] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port aa9d8557-c16c-408d-83d4-2578f1fd2a60 not found, creating... [ 1120.806416] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.806627] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.806823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.807126] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.807339] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.807731] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.807920] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.808184] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.808464] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.808841] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.809114] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: aa9d8557-c16c-408d-83d4-2578f1fd2a60 is going to be created. [ 1120.830239] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.830461] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.830582] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.830862] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.831184] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.831440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-aa9d8557-c16c-408d-83d4-2578f1fd2a60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.850503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.850727] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.850814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.851136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.851310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.851436] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763682a6-c9f9-4906-bec2-c14372760919 is going to be created. [ 1120.879550] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.879760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.879760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.879952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.880151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.892074] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763682a6-c9f9-4906-bec2-c14372760919 in Status: UNINITIALIZED for 2s [ 1120.965958] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.468645] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.469027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.469027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.469220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.469284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.469379] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be updated. [ 1121.505403] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.505720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.505720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.505927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.506455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.516545] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: IN_PROGRESS for 2s [ 1121.578772] env[65992]: INFO networking_nsxv3.common.synchronization [req-c3d27a3c-b8c6-4626-aba3-357411cd1f75 req-86073647-d33d-427c-a24a-3954bf38875d service nova] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_rules [ 1121.579035] env[65992]: INFO networking_nsxv3.common.synchronization [req-c3d27a3c-b8c6-4626-aba3-357411cd1f75 req-86073647-d33d-427c-a24a-3954bf38875d service nova] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 1121.579203] env[65992]: INFO networking_nsxv3.common.synchronization [req-c3d27a3c-b8c6-4626-aba3-357411cd1f75 req-86073647-d33d-427c-a24a-3954bf38875d service nova] Enqueued Resource ID: aa9d8557-c16c-408d-83d4-2578f1fd2a60 with Priority: HIGHEST for action port [ 1121.579762] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_rules [ 1121.580917] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 1121.581131] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa9d8557-c16c-408d-83d4-2578f1fd2a60 with Priority: HIGHEST for action port [ 1121.581450] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.581584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.581639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.581850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.581915] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.583926] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.583926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.583926] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa9d8557-c16c-408d-83d4-2578f1fd2a60 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.583926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa9d8557-c16c-408d-83d4-2578f1fd2a60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.583926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa9d8557-c16c-408d-83d4-2578f1fd2a60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.583926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa9d8557-c16c-408d-83d4-2578f1fd2a60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.583926] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa9d8557-c16c-408d-83d4-2578f1fd2a60',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.087053] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.088055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.088055] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa9d8557-c16c-408d-83d4-2578f1fd2a60 with status ACTIVE [ 1122.088055] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.088055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.088055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.088055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.088055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.088355] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.088355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.088355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.088445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.088476] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.088655] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.088742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.088799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.088931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.089186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.089186] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa9d8557-c16c-408d-83d4-2578f1fd2a60 is going to be updated. [ 1122.111326] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.111473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.111542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.111752] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.111884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.112056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa9d8557-c16c-408d-83d4-2578f1fd2a60" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.281182] env[65992]: INFO networking_nsxv3.common.synchronization [req-5557b288-ffbb-42fe-8259-e2aa987853a0 req-e938c77d-c1e9-4833-ab0c-0deec137f3ea tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1122.281714] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1122.282082] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.282263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.282350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.282728] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.282920] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.283037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.283104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.283273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.283355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.283456] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.657655] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.658059] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.658059] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.658347] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.658956] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.659164] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.659289] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.659533] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.659678] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.659890] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.660014] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.660173] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.660317] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.660443] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.660506] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.660635] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.682053] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.682053] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.682053] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.682295] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.682426] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-ed1a7ca2-873b-4833-aa50-93b3bd90610f taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.682601] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-ed1a7ca2-873b-4833-aa50-93b3bd90610f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.682718] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-ed1a7ca2-873b-4833-aa50-93b3bd90610f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.683069] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-ed1a7ca2-873b-4833-aa50-93b3bd90610f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.683208] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1a7ca2-873b-4833-aa50-93b3bd90610f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.786719] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.786896] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.786945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.788484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.788484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.788484] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.788484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.788484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.788484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.788484] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.788484] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1122.816804] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.817015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.817015] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.817239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.817377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.827934] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1122.904739] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763682a6-c9f9-4906-bec2-c14372760919 in Status: SUCCESS [ 1122.904739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.904739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.904739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.904739] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.904739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.904739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.904739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.904739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.904739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.904739] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.185400] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.185649] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.185786] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.186094] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.186258] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.186673] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port ed1a7ca2-873b-4833-aa50-93b3bd90610f not found, creating... [ 1123.186673] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.186866] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.186963] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.187225] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.187372] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.187660] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.187817] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.187945] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.188295] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.188430] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.188564] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: ed1a7ca2-873b-4833-aa50-93b3bd90610f is going to be created. [ 1123.213031] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.213031] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.213031] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.213272] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.213467] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.213676] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-ed1a7ca2-873b-4833-aa50-93b3bd90610f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.407884] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.530332] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 1123.530635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.530874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.531244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.531499] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.532718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.532718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.532718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.532718] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.532718] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.910546] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 763682a6-c9f9-4906-bec2-c14372760919: rpc.has_security_group_logging(os_id): False [ 1123.930155] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.930284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.930368] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.930977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.930977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.930977] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.931166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.931284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.931403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.931477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.931566] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763682a6-c9f9-4906-bec2-c14372760919 is going to be created. [ 1123.975705] env[65992]: INFO networking_nsxv3.common.synchronization [req-5557b288-ffbb-42fe-8259-e2aa987853a0 req-e0bd77f8-39c1-41f9-8aa2-73f4368895c5 service nova] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 1123.975705] env[65992]: INFO networking_nsxv3.common.synchronization [req-5557b288-ffbb-42fe-8259-e2aa987853a0 req-e0bd77f8-39c1-41f9-8aa2-73f4368895c5 service nova] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1123.976057] env[65992]: INFO networking_nsxv3.common.synchronization [req-5557b288-ffbb-42fe-8259-e2aa987853a0 req-e0bd77f8-39c1-41f9-8aa2-73f4368895c5 service nova] Enqueued Resource ID: ed1a7ca2-873b-4833-aa50-93b3bd90610f with Priority: HIGHEST for action port [ 1123.976974] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 1123.977066] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1123.977481] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed1a7ca2-873b-4833-aa50-93b3bd90610f with Priority: HIGHEST for action port [ 1123.977633] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.977862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.977862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.978021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.978108] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.979233] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.979391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.979901] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed1a7ca2-873b-4833-aa50-93b3bd90610f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.980053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed1a7ca2-873b-4833-aa50-93b3bd90610f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.980133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed1a7ca2-873b-4833-aa50-93b3bd90610f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.980466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed1a7ca2-873b-4833-aa50-93b3bd90610f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.980563] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1a7ca2-873b-4833-aa50-93b3bd90610f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.001020] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.001331] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.001414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.001621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.001797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.017602] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 763682a6-c9f9-4906-bec2-c14372760919 in Status: IN_PROGRESS for 2s [ 1124.034698] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.483300] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed1a7ca2-873b-4833-aa50-93b3bd90610f with status ACTIVE [ 1124.483807] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.484033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.484179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.485071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.485254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.485644] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.485846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.485962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.486638] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.487107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.487618] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.487954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.488171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.488505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.488789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.489035] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed1a7ca2-873b-4833-aa50-93b3bd90610f is going to be updated. [ 1124.491274] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.491436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.517883] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.518108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.518265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.518749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.518749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.519020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed1a7ca2-873b-4833-aa50-93b3bd90610f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.537815] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.842943] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1124.843142] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 deletion is rescheduled due to dependency. [ 1124.843308] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.843429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.843656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.843834] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.843954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.844028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.844180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.844260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.844353] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.041707] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.042017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.042054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.042423] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.042533] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.042685] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be updated. [ 1125.079815] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.080811] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.080908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.081196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.081365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.096156] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: IN_PROGRESS for 2s [ 1125.348505] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.854503] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.049151] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 763682a6-c9f9-4906-bec2-c14372760919 in Status: SUCCESS [ 1126.049599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.357084] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.358062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.358182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.358620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.358620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.358762] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1126.396500] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.396954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.398054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.398054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.398054] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.417060] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1127.106140] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 1127.106410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.106566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.106743] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.106932] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.107060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.107120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.107279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.107363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.107430] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.107517] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.610188] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.112759] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58a9088b-471e-48ab-8bf1-877d11c93872: rpc.has_security_group_logging(os_id): False [ 1128.132711] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.132912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.132999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.133244] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.133360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.133689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.133844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.133916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.134138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.134221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.134313] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be updated. [ 1128.188906] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.189119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.189168] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.189441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.189609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.208633] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: IN_PROGRESS for 2s [ 1128.430570] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1128.430998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.431413] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.431890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.432502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.432941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.433027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.433639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.433639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.433639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.433639] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.937237] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.978561] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1128.978709] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1129.445834] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92df56c0-4890-4336-9656-3c0ad1e3b068: rpc.has_security_group_logging(os_id): False [ 1129.465845] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.465845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.465845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.466124] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.466239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.467131] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.467439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.467510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.467927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.468025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.468113] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1129.545447] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.545696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.545696] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.545872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.546025] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.558646] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1130.222394] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 1130.222631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.573377] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1131.573726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.981802] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1133.982244] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1138.983607] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1138.983992] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1143.985042] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1143.985438] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1144.182750] env[65992]: INFO networking_nsxv3.common.synchronization [req-3ffc814b-46b5-4c27-9d13-ae78adff2035 req-e4d16508-6596-4770-9836-8aca9f7ff602 tempest-ServerActionsTestOtherB-918399856 tempest-ServerActionsTestOtherB-918399856-project-member] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1144.183301] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1144.183611] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.184071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.184071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.184071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.184570] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.184570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.184570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.184753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.184753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.184865] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.687061] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.687285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.687402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.687697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.687697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.687910] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.688083] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.688120] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.688260] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.688361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.688422] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1144.723214] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.723428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.723491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.723724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.723938] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.735667] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1145.231140] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2102413-7dad-4bca-bdd0-0ce2e6e8fea8 req-516f833d-816e-4ca2-8149-ec1df5f1e3c0 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1145.231696] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1145.232011] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.232150] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.232217] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.232403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.232559] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.232658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.232716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.232870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.232954] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.233338] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.575199] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.575421] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.575509] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.575800] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.576071] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.576212] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.576345] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.576586] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.576730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.576999] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.577072] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.577160] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.577302] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.577414] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.577532] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.577636] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.597130] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.597289] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1145.597414] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.597589] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.597903] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-520a59fa-9cab-404b-9b10-0018d1534e2b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.598090] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-520a59fa-9cab-404b-9b10-0018d1534e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.598237] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-520a59fa-9cab-404b-9b10-0018d1534e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.598550] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-520a59fa-9cab-404b-9b10-0018d1534e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.598676] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('520a59fa-9cab-404b-9b10-0018d1534e2b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.735863] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.736127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.736127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.736284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.736341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.736586] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.736783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.736931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.737019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.737167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.737266] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1145.792078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.792309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.792309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.792522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.792701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.804696] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1146.100996] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.101286] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.101536] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.102046] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.102229] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.102521] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 520a59fa-9cab-404b-9b10-0018d1534e2b not found, creating... [ 1146.102883] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.103125] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.103296] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.103778] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.103879] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.104197] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.104377] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.104550] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.104909] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.105034] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.105231] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 520a59fa-9cab-404b-9b10-0018d1534e2b is going to be created. [ 1146.128797] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.129040] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.129152] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.129694] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.129802] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.129994] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-520a59fa-9cab-404b-9b10-0018d1534e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.747113] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1146.747532] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c deletion is rescheduled due to dependency. [ 1146.747735] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.844372] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2102413-7dad-4bca-bdd0-0ce2e6e8fea8 req-db7257f7-26df-4ae7-a705-f615c40df440 service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1146.844563] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2102413-7dad-4bca-bdd0-0ce2e6e8fea8 req-db7257f7-26df-4ae7-a705-f615c40df440 service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1146.844745] env[65992]: INFO networking_nsxv3.common.synchronization [req-f2102413-7dad-4bca-bdd0-0ce2e6e8fea8 req-db7257f7-26df-4ae7-a705-f615c40df440 service nova] Enqueued Resource ID: 520a59fa-9cab-404b-9b10-0018d1534e2b with Priority: HIGHEST for action port [ 1146.845318] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1146.845470] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1146.845582] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 520a59fa-9cab-404b-9b10-0018d1534e2b with Priority: HIGHEST for action port [ 1146.845879] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.846367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.846518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.846796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.846919] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.848112] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.848398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.848731] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-520a59fa-9cab-404b-9b10-0018d1534e2b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.848998] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-520a59fa-9cab-404b-9b10-0018d1534e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.849104] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-520a59fa-9cab-404b-9b10-0018d1534e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.849327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-520a59fa-9cab-404b-9b10-0018d1534e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.849436] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('520a59fa-9cab-404b-9b10-0018d1534e2b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.351368] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.351593] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.351753] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 520a59fa-9cab-404b-9b10-0018d1534e2b with status ACTIVE [ 1147.351941] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.352071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.352138] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.352372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.352465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.352727] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.352837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.352898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.353103] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.353229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.353495] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.353664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.353764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.354041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.354130] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.354226] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 520a59fa-9cab-404b-9b10-0018d1534e2b is going to be updated. [ 1147.378763] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.379045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.379045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.379156] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.379319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.379526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-520a59fa-9cab-404b-9b10-0018d1534e2b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.816080] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1147.816080] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 deletion is rescheduled due to dependency. [ 1147.816080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.816080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.816080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.816589] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.816589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.816589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.816589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.816720] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.816748] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.318969] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.821447] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.846847] env[65992]: INFO networking_nsxv3.common.synchronization [req-a43e93df-13b6-4216-9992-f213d551c3a2 req-72b900b9-08ea-4add-bd39-e3df6ff6410f tempest-ServersTestManualDisk-218777903 tempest-ServersTestManualDisk-218777903-project-member] Enqueued Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_members [ 1148.847445] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f with Priority: HIGHEST for action security_group_members [ 1148.847861] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.847945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.847982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.848179] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.848329] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.848429] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.848488] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.848637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.848739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.848835] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed0b38e7-705e-40dd-972f-3a9d14a5f23f',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.324105] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.324270] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.324342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.324556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.324647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.324744] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1149.352227] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.352415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.352573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.353416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.353416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.353416] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.353416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.353416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.353416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.353416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.353740] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f is going to be updated. [ 1149.358908] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.358908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.358908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.358908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.358908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.371030] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1149.393890] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.394283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.394524] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.396017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.396017] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.404659] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f in Status: IN_PROGRESS for 2s [ 1151.381955] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1151.382365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.382365] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.382640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.382725] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.382842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.382908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.383085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.383164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.383248] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.383339] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.414289] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f in Status: SUCCESS [ 1151.414509] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed0b38e7-705e-40dd-972f-3a9d14a5f23f deletion is rescheduled due to dependency. [ 1151.414650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed0b38e7-705e-40dd-972f-3a9d14a5f23f" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.886460] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.886819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.886973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.887341] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.887729] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.887910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.888036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.888295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.888574] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.888722] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.888983] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.889170] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.889279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.889600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.889832] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.889988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.890101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.890318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.890451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.890599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.890757] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.275358] env[65992]: INFO networking_nsxv3.common.synchronization [None req-f7503d19-8863-45c3-a961-21ad19d3dafd tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1152.275903] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1152.277545] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.278048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.278048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.278048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.278162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.278228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.278355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.278604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.278604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.278737] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.394154] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a25c9a9c-e9a8-445f-ad80-439686ed1021: rpc.has_security_group_logging(os_id): False [ 1152.417042] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.417219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.417318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.417523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.417618] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.417868] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.417978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.418047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.418193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.418262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.418455] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.418550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.418601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.418739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.418813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.418973] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.420936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.420936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.420936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.420936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.420936] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1152.492579] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.492809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.492809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.493115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.493269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.508556] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1152.781345] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.284204] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.786904] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.787339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.787339] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.787422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.787451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.787549] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1153.822828] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.822828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.822828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.822828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.822828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.837958] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1154.522324] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1154.522480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.795309] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.795662] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.795662] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.796053] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.796420] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.796667] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.796915] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.797267] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.797492] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.797806] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.797996] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.798189] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.798359] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.798544] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.798711] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.798892] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1154.817872] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1154.820750] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1154.820750] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1154.820750] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.820750] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-34e965c2-52d2-4a4c-a612-98320340827b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.820750] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-34e965c2-52d2-4a4c-a612-98320340827b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.820750] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-34e965c2-52d2-4a4c-a612-98320340827b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.820750] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-34e965c2-52d2-4a4c-a612-98320340827b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.820750] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34e965c2-52d2-4a4c-a612-98320340827b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.327336] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.327569] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.327692] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.328015] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.328175] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.328326] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 34e965c2-52d2-4a4c-a612-98320340827b not found, creating... [ 1155.328588] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.328759] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.328872] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.329101] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.329236] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.329549] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.329699] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.329834] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.330053] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.330239] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.330318] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 34e965c2-52d2-4a4c-a612-98320340827b is going to be created. [ 1155.353240] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.353433] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.354392] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.354392] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.354392] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.354392] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-34e965c2-52d2-4a4c-a612-98320340827b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.853770] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1155.854062] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.048905] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8428698-b593-42bf-8654-52b17944863c req-1cdd42f7-c2fb-405d-b0c1-10e2aa2a9f30 tempest-ServerActionsTestOtherB-918399856 tempest-ServerActionsTestOtherB-918399856-project-member] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1156.049730] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1156.049985] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.050140] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.050230] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.050411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.050664] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.050664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.050784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.050864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.051078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.051078] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.100878] env[65992]: INFO networking_nsxv3.common.synchronization [req-b0bcf238-ae5e-498f-88f2-220901c5fa21 req-1adf8291-89d5-4a93-a3b6-65f3d8bf4a16 service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1156.100878] env[65992]: INFO networking_nsxv3.common.synchronization [req-b0bcf238-ae5e-498f-88f2-220901c5fa21 req-1adf8291-89d5-4a93-a3b6-65f3d8bf4a16 service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1156.100878] env[65992]: INFO networking_nsxv3.common.synchronization [req-b0bcf238-ae5e-498f-88f2-220901c5fa21 req-1adf8291-89d5-4a93-a3b6-65f3d8bf4a16 service nova] Enqueued Resource ID: 34e965c2-52d2-4a4c-a612-98320340827b with Priority: HIGHEST for action port [ 1156.100878] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1156.100878] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1156.100878] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34e965c2-52d2-4a4c-a612-98320340827b with Priority: HIGHEST for action port [ 1156.102451] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.102869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.103091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.106026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.106026] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.106026] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.106026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.106026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.106026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.106781] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.107064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.107297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.107660] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.107960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.108752] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.110366] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-34e965c2-52d2-4a4c-a612-98320340827b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.110662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34e965c2-52d2-4a4c-a612-98320340827b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.110823] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34e965c2-52d2-4a4c-a612-98320340827b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.111228] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34e965c2-52d2-4a4c-a612-98320340827b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.111439] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34e965c2-52d2-4a4c-a612-98320340827b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.401545] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.401774] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.401900] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.402191] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.402453] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.402640] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.402757] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.402973] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.403165] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.403420] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.403548] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.403654] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.403759] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.403864] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.403963] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.404102] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.430463] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.430699] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1156.431034] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.431325] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.431838] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-c52dc0f4-e4f5-409a-8d48-c2023e853c95 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.432143] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-c52dc0f4-e4f5-409a-8d48-c2023e853c95" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.432323] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-c52dc0f4-e4f5-409a-8d48-c2023e853c95" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.432734] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-c52dc0f4-e4f5-409a-8d48-c2023e853c95" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.432913] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c52dc0f4-e4f5-409a-8d48-c2023e853c95',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.554676] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.554676] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.554889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.555095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.555215] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.555450] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.555596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.555685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.555910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.556043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.556156] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1156.583342] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.583493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.583535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.583759] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.583990] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.593664] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1156.613443] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.614715] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.614715] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.615286] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34e965c2-52d2-4a4c-a612-98320340827b with status ACTIVE [ 1156.615286] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.615286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.615286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.615449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.615449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.615632] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.615761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.615805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.615943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.616035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.617520] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.617520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.617520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.617520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.617520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.617520] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34e965c2-52d2-4a4c-a612-98320340827b is going to be updated. [ 1156.641713] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.641713] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.641928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.641967] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.642119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.642292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34e965c2-52d2-4a4c-a612-98320340827b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.937643] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.937643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.937643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.937643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.937643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.937643] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port c52dc0f4-e4f5-409a-8d48-c2023e853c95 not found, creating... [ 1156.937643] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.937643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.937643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.937643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.937643] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.938730] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.938730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.938730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.938730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.938730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.938730] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: c52dc0f4-e4f5-409a-8d48-c2023e853c95 is going to be created. [ 1156.959045] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.959045] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.959045] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.959331] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.959331] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.959634] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-c52dc0f4-e4f5-409a-8d48-c2023e853c95" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.120453] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.624344] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.624556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.624595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.625019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.625163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.625271] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1157.663813] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.663961] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.664042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.664254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.664393] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.675014] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1157.678188] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8428698-b593-42bf-8654-52b17944863c req-e16b5808-f99a-4f9a-b1d5-ba53f98ca863 service nova] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 1157.678188] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8428698-b593-42bf-8654-52b17944863c req-e16b5808-f99a-4f9a-b1d5-ba53f98ca863 service nova] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1157.678188] env[65992]: INFO networking_nsxv3.common.synchronization [req-b8428698-b593-42bf-8654-52b17944863c req-e16b5808-f99a-4f9a-b1d5-ba53f98ca863 service nova] Enqueued Resource ID: c52dc0f4-e4f5-409a-8d48-c2023e853c95 with Priority: HIGHEST for action port [ 1157.678188] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 1157.678188] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1157.678188] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c52dc0f4-e4f5-409a-8d48-c2023e853c95 with Priority: HIGHEST for action port [ 1157.678731] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.678849] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.678936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.682443] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.682586] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.684010] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.684010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.684010] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c52dc0f4-e4f5-409a-8d48-c2023e853c95 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.684010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c52dc0f4-e4f5-409a-8d48-c2023e853c95" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.684010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c52dc0f4-e4f5-409a-8d48-c2023e853c95" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.684269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c52dc0f4-e4f5-409a-8d48-c2023e853c95" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.684269] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c52dc0f4-e4f5-409a-8d48-c2023e853c95',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.991351] env[65992]: INFO networking_nsxv3.common.synchronization [None req-114b30f8-e1d2-4f95-a39c-594ae4c0ed17 None None] Enqueued Resource ID: 0f6fbc8b-707b-42ee-879f-b4938ab1789e with Priority: HIGHEST for action port [ 1157.991351] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6fbc8b-707b-42ee-879f-b4938ab1789e with Priority: HIGHEST for action port [ 1157.991844] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f6fbc8b-707b-42ee-879f-b4938ab1789e taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.991844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f6fbc8b-707b-42ee-879f-b4938ab1789e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.991844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f6fbc8b-707b-42ee-879f-b4938ab1789e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.991975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f6fbc8b-707b-42ee-879f-b4938ab1789e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.993123] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f6fbc8b-707b-42ee-879f-b4938ab1789e',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.186216] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.186355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.186598] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c52dc0f4-e4f5-409a-8d48-c2023e853c95 with status ACTIVE [ 1158.186782] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.186904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.186987] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.187233] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.187336] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.187535] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.187650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.187704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.187846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.187921] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.188154] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.188300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.188300] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.188469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.188543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.188629] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c52dc0f4-e4f5-409a-8d48-c2023e853c95 is going to be updated. [ 1158.220376] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.220510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.220585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.220778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.220907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.221084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c52dc0f4-e4f5-409a-8d48-c2023e853c95" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.494148] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f6fbc8b-707b-42ee-879f-b4938ab1789e [ 1158.494416] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.494552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.494624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.494866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.494947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.495063] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f6fbc8b-707b-42ee-879f-b4938ab1789e already deleted. [ 1158.495141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f6fbc8b-707b-42ee-879f-b4938ab1789e" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.607061] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1158.607061] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c deletion is rescheduled due to dependency. [ 1158.607061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.607061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.607352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.607352] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.607447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.607447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.607624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.607767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.607820] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.110665] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.613028] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.685774] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1159.685991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.686212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.686459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.686669] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.686793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.686857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.687036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.687118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.687274] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.687344] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.006975] env[65992]: INFO networking_nsxv3.common.synchronization [None req-6ed77461-8e04-4e24-82be-c6a6309a5031 None None] Enqueued Resource ID: 77dfae0c-493b-4f3e-9147-5960e07fc683 with Priority: HIGHEST for action port [ 1160.008632] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dfae0c-493b-4f3e-9147-5960e07fc683 with Priority: HIGHEST for action port [ 1160.008965] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-77dfae0c-493b-4f3e-9147-5960e07fc683 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.009128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77dfae0c-493b-4f3e-9147-5960e07fc683" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.009385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77dfae0c-493b-4f3e-9147-5960e07fc683" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.009570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77dfae0c-493b-4f3e-9147-5960e07fc683" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.009674] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77dfae0c-493b-4f3e-9147-5960e07fc683',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.115874] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.116354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.116354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.116354] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.116529] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.116565] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1160.154200] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.154379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.154379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.154606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.154753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.167636] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1160.190315] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.190549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.190549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.190768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.191219] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.191219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.191219] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.191389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.191389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.191473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.191639] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.191729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.192707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.192707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.192707] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.192707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.192707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.192707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.192707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.192707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.192707] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.512220] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77dfae0c-493b-4f3e-9147-5960e07fc683 [ 1160.512468] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.512561] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.512631] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.512884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.512974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.513080] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77dfae0c-493b-4f3e-9147-5960e07fc683 already deleted. [ 1160.513164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77dfae0c-493b-4f3e-9147-5960e07fc683" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.695439] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a25c9a9c-e9a8-445f-ad80-439686ed1021: rpc.has_security_group_logging(os_id): False [ 1160.714094] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.714285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.714324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.714509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.714601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.714806] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.714900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.714959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.715123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.715199] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.715385] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.715472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.715536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.715667] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.715739] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.715913] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.716016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.716074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.716208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.716279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.716363] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1160.802473] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.802669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.802716] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.803029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.803294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.822773] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1162.177814] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1162.178119] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.178216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.178420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.178607] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.178724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.178821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.178932] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.179041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.179099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.179181] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.681278] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.838126] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1162.838126] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.186430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c: rpc.has_security_group_logging(os_id): False [ 1163.207411] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.207570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.207641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.207895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.207996] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.208285] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.208390] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.208454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.208607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.208685] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.208773] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1163.275032] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.275032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.275032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.275312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.275312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.291765] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1163.613549] env[65992]: INFO networking_nsxv3.common.synchronization [req-5917b61a-fdda-4162-b9f4-971657563b79 req-42eac9c8-5448-4171-b34f-060893977415 tempest-ServerMetadataNegativeTestJSON-1211435447 tempest-ServerMetadataNegativeTestJSON-1211435447-project-member] Enqueued Resource ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 with Priority: HIGHEST for action security_group_members [ 1163.614970] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 with Priority: HIGHEST for action security_group_members [ 1163.615313] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.615438] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.615505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.615756] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.615920] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.616046] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.616100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.616254] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.616338] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.616452] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.975953] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.976162] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-980" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.976285] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-980" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.976613] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-980" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.976864] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.977033] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.977150] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.977366] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.977517] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.977750] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.977863] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.977981] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.978083] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.978232] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.978352] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.978435] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.000072] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.000072] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1164.000072] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.000072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-980" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.000072] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-40b6d28a-04e3-48fa-90c3-245ff445bc5b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.000072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-40b6d28a-04e3-48fa-90c3-245ff445bc5b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.000072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-40b6d28a-04e3-48fa-90c3-245ff445bc5b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.000072] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-40b6d28a-04e3-48fa-90c3-245ff445bc5b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.000072] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40b6d28a-04e3-48fa-90c3-245ff445bc5b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.119461] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.119680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.119680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.119952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.120097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.120276] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.120382] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.120468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.120592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.120668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.120751] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 already deleted. [ 1164.120829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.502690] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.502690] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.502690] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.503231] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.503231] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.503231] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 40b6d28a-04e3-48fa-90c3-245ff445bc5b not found, creating... [ 1164.503499] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.503666] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.503781] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.503998] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.504146] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.504521] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.504736] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.504885] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.505171] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.505351] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.505514] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 40b6d28a-04e3-48fa-90c3-245ff445bc5b is going to be created. [ 1164.526049] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.526282] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.526383] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.526654] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.526925] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.527450] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-40b6d28a-04e3-48fa-90c3-245ff445bc5b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.255400] env[65992]: INFO networking_nsxv3.common.synchronization [req-5917b61a-fdda-4162-b9f4-971657563b79 req-dd71824a-c57e-46a0-a131-5e06e0890be7 service nova] Enqueued Resource ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 with Priority: HIGHEST for action security_group_rules [ 1165.255612] env[65992]: INFO networking_nsxv3.common.synchronization [req-5917b61a-fdda-4162-b9f4-971657563b79 req-dd71824a-c57e-46a0-a131-5e06e0890be7 service nova] Enqueued Resource ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 with Priority: HIGHEST for action security_group_members [ 1165.255763] env[65992]: INFO networking_nsxv3.common.synchronization [req-5917b61a-fdda-4162-b9f4-971657563b79 req-dd71824a-c57e-46a0-a131-5e06e0890be7 service nova] Enqueued Resource ID: 40b6d28a-04e3-48fa-90c3-245ff445bc5b with Priority: HIGHEST for action port [ 1165.256289] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 with Priority: HIGHEST for action security_group_rules [ 1165.256437] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 with Priority: HIGHEST for action security_group_members [ 1165.256566] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40b6d28a-04e3-48fa-90c3-245ff445bc5b with Priority: HIGHEST for action port [ 1165.256876] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.256999] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.258402] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.259699] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.262909] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.263917] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.264071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.264141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.264352] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.264530] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.264645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.265231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.265447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.265553] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.265650] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.269625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-40b6d28a-04e3-48fa-90c3-245ff445bc5b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.269749] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40b6d28a-04e3-48fa-90c3-245ff445bc5b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.269799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40b6d28a-04e3-48fa-90c3-245ff445bc5b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.269962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40b6d28a-04e3-48fa-90c3-245ff445bc5b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.270054] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40b6d28a-04e3-48fa-90c3-245ff445bc5b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.306156] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1165.306398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.771508] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.771960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.771960] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.776704] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40b6d28a-04e3-48fa-90c3-245ff445bc5b with status ACTIVE [ 1165.776878] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.776959] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.777045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.777538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.777538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.777538] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.778247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.778247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.778247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.778247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.778247] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.778247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.778247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.778600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.778600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.778600] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40b6d28a-04e3-48fa-90c3-245ff445bc5b is going to be updated. [ 1165.798723] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.798916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.799579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.799579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.799579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.799579] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40b6d28a-04e3-48fa-90c3-245ff445bc5b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.273817] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.776370] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.776687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.776687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.776687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.776847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.776941] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 is going to be created. [ 1166.800565] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.800712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.800783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.800989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.801160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.812078] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 in Status: UNINITIALIZED for 2s [ 1168.824748] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 in Status: SUCCESS [ 1168.825121] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.825235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.825515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.825780] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.825931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.826048] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.826367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.826367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.826853] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.826853] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.329028] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.329225] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.329263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.329555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.329786] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.329913] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.330045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.330222] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.330312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.330431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.330588] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.330906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.330992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.332152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.332152] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.332152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.332152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.332152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.332152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.332152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.332152] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.528578] env[65992]: INFO networking_nsxv3.common.synchronization [req-b5a8dd80-4d31-4dcf-90bd-f35208656ade req-7094ff7f-99f4-4c08-b164-4ee84abdb8c9 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_members [ 1169.529818] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGHEST for action security_group_members [ 1169.529982] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.530929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.530929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.531301] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.531457] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.531605] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.531692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.531884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.531962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.532103] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.836641] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3: rpc.has_security_group_logging(os_id): False [ 1169.858848] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.858848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.858848] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.859226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.859427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.859671] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.859785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.859851] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.860020] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.860099] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.860285] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.860380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.860441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.860571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.860654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.860829] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.860924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.860970] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.861216] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.861317] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.861428] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 is going to be created. [ 1169.920926] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.921213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.921523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.921814] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.922016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.934843] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 in Status: IN_PROGRESS for 2s [ 1170.036675] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.036866] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.036910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.037157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.037252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.037476] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.037588] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.037651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.037806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.037885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.037975] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b is going to be updated. [ 1170.118816] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.119141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.119141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.119340] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.119732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.132332] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b in Status: IN_PROGRESS for 2s [ 1170.194473] env[65992]: INFO networking_nsxv3.common.synchronization [req-0fba9815-ce61-41d3-940b-73f4aef8aef3 req-6421e5ca-80e4-427b-8034-9ab445dae17c tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1170.195087] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1170.195424] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.195538] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.195611] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.195820] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.195978] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.197793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.197793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.197793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.197793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.197793] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.700540] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.128934] env[65992]: INFO networking_nsxv3.common.synchronization [None req-d3eb8879-cf4d-4e1c-90a5-ed781cd03d30 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1171.130549] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1171.130694] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.130835] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.203886] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.706865] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.706865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.706865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.707186] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.708169] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.708169] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1171.744313] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.744475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.744521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.744737] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.745174] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.758333] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1171.948867] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 in Status: SUCCESS [ 1171.949123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.147646] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b in Status: SUCCESS [ 1172.148022] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b deletion is rescheduled due to dependency. [ 1172.148134] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.771253] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1173.771687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.771687] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.771924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.772292] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.772292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.772436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.772480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.772563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.772658] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.844906] env[65992]: INFO networking_nsxv3.common.synchronization [req-1ec39085-1099-4f12-92a5-2ba5cfd17075 req-f93611ba-da62-46ee-83d0-335e30e1d109 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_members [ 1173.845640] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGHEST for action security_group_members [ 1173.845640] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-6743c98c-32bc-40d6-b15c-7a982090892d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.845640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.845828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.845917] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.846087] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.846188] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.846252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.846399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.846520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.846647] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.274880] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.274880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.274880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.275145] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.275238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.275453] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.275955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.275955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.275955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.275955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.276160] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1174.303627] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.303627] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.303742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.304111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.304305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.313674] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1174.349592] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.349748] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.349872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.350226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.350404] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.350747] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.351164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.351164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.351307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.351431] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.351980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6743c98c-32bc-40d6-b15c-7a982090892d is going to be updated. [ 1174.385683] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.385880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.385880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.386407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.386407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.400099] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6743c98c-32bc-40d6-b15c-7a982090892d in Status: IN_PROGRESS for 2s [ 1175.568181] env[65992]: INFO networking_nsxv3.common.synchronization [None req-3a331cb8-9015-4826-bce8-7e4f94e3427d tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_rules [ 1175.568949] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_rules [ 1175.569347] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5147b71-0080-456f-8195-21323de6a67d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.569523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.569637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.569953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.570093] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.707367] env[65992]: INFO networking_nsxv3.common.synchronization [None req-ce50ffbf-69b5-40d4-bf0a-749db0f9c212 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_rules [ 1175.707875] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_rules [ 1175.708221] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5147b71-0080-456f-8195-21323de6a67d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.708305] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.092715] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.092975] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.093137] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.093242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.093329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.093425] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5147b71-0080-456f-8195-21323de6a67d already deleted. [ 1176.093505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.093655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.093805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.093922] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.327804] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1176.327981] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 deletion is rescheduled due to dependency. [ 1176.328108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.411599] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6743c98c-32bc-40d6-b15c-7a982090892d in Status: SUCCESS [ 1176.411839] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6743c98c-32bc-40d6-b15c-7a982090892d deletion is rescheduled due to dependency. [ 1176.411918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.607070] env[65992]: INFO networking_nsxv3.common.synchronization [req-92fdfeed-d8a1-4b7d-a8cd-b770dde019ce req-8fd4d631-586c-4234-a11c-1fbd8398c98c tempest-ServerMetadataNegativeTestJSON-1211435447 tempest-ServerMetadataNegativeTestJSON-1211435447-project-member] Enqueued Resource ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 with Priority: HIGHEST for action security_group_members [ 1176.607522] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 with Priority: HIGHEST for action security_group_members [ 1176.608015] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.608157] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.608316] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.608428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.608594] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.608681] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.608746] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.608895] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.609014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.609130] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.614783] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.615026] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.615097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.615321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.615498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.615498] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5147b71-0080-456f-8195-21323de6a67d already deleted. [ 1176.615601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.111499] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.113037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.113037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.113037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.113037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.113037] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.113037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.113037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.113037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.113037] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.113037] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 is going to be updated. [ 1177.147123] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.147373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.147373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.147702] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.147857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.160500] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 in Status: IN_PROGRESS for 2s [ 1178.606448] env[65992]: INFO networking_nsxv3.common.synchronization [None req-4f60c83c-e042-44b0-99fd-78d52a8bd007 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_rules [ 1178.606744] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_rules [ 1178.606843] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.607016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.607081] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.607293] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.607373] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.690872] env[65992]: INFO networking_nsxv3.common.synchronization [None req-cdfe7bf7-e6a8-4910-bf34-026649ca1e80 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_rules [ 1178.691088] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_rules [ 1178.691391] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.691491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.127672] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.127863] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.127934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.128232] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.128357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.128486] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c719830-8963-41da-a846-e107a5d18360 already deleted. [ 1179.128600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.128791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.129013] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.129122] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.171251] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 in Status: SUCCESS [ 1179.171439] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3 deletion is rescheduled due to dependency. [ 1179.171552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.650427] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.650797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.650797] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.650889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.650974] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.651082] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c719830-8963-41da-a846-e107a5d18360 already deleted. [ 1179.651164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.057111] env[65992]: INFO networking_nsxv3.common.synchronization [req-e1f88f72-7f51-4681-9041-ca4ba9e5f22f req-16c0b734-2bd0-4c70-88cd-1d4c52d975b5 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_members [ 1183.057448] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_members [ 1183.057758] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5147b71-0080-456f-8195-21323de6a67d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.057899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.057936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.058240] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.058421] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.058497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.058606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.058705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.058786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.062585] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.447408] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.447631] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.447802] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.448036] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.448331] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.448547] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.448636] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.448857] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.448997] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.449469] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.449469] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.449618] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.449618] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.449711] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.449793] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.450030] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.472808] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.472808] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1183.472808] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.472808] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-347" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.473696] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-513bf757-dc94-4c93-81c5-d4589e55c0a8 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.473696] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-513bf757-dc94-4c93-81c5-d4589e55c0a8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.473696] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-513bf757-dc94-4c93-81c5-d4589e55c0a8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.473937] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-513bf757-dc94-4c93-81c5-d4589e55c0a8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.473937] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513bf757-dc94-4c93-81c5-d4589e55c0a8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.562291] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.562604] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.562686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.562956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.563042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.563445] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.563445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.563445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.563608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.563608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.563675] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5147b71-0080-456f-8195-21323de6a67d already deleted. [ 1183.563730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.975945] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.976205] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.976329] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.976599] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.976743] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.976895] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 513bf757-dc94-4c93-81c5-d4589e55c0a8 not found, creating... [ 1183.977168] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.977325] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.977452] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.977636] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.977765] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.978045] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.978202] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.978314] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.978511] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.978638] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.978772] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 513bf757-dc94-4c93-81c5-d4589e55c0a8 is going to be created. [ 1183.999507] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.999840] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.999936] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.000148] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.000415] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.000712] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-513bf757-dc94-4c93-81c5-d4589e55c0a8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.710623] env[65992]: INFO networking_nsxv3.common.synchronization [req-e1f88f72-7f51-4681-9041-ca4ba9e5f22f req-a3941b44-ee61-46b9-b264-3ecd80855546 service nova] Enqueued Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_rules [ 1184.711158] env[65992]: INFO networking_nsxv3.common.synchronization [req-e1f88f72-7f51-4681-9041-ca4ba9e5f22f req-a3941b44-ee61-46b9-b264-3ecd80855546 service nova] Enqueued Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_members [ 1184.711671] env[65992]: INFO networking_nsxv3.common.synchronization [req-e1f88f72-7f51-4681-9041-ca4ba9e5f22f req-a3941b44-ee61-46b9-b264-3ecd80855546 service nova] Enqueued Resource ID: 513bf757-dc94-4c93-81c5-d4589e55c0a8 with Priority: HIGHEST for action port [ 1184.713185] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_rules [ 1184.714231] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_members [ 1184.714231] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513bf757-dc94-4c93-81c5-d4589e55c0a8 with Priority: HIGHEST for action port [ 1184.714231] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5147b71-0080-456f-8195-21323de6a67d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.714231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.714231] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.714596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.714596] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.715471] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5147b71-0080-456f-8195-21323de6a67d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.715745] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.715868] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.716097] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.716305] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.716463] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.716568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.717027] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.717175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.717323] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.718165] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-513bf757-dc94-4c93-81c5-d4589e55c0a8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.718353] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-513bf757-dc94-4c93-81c5-d4589e55c0a8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.719386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-513bf757-dc94-4c93-81c5-d4589e55c0a8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.719599] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-513bf757-dc94-4c93-81c5-d4589e55c0a8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.719729] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513bf757-dc94-4c93-81c5-d4589e55c0a8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.222364] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.223696] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5147b71-0080-456f-8195-21323de6a67d taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.223873] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.224032] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 513bf757-dc94-4c93-81c5-d4589e55c0a8 with status ACTIVE [ 1185.225029] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.225029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.225029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.225029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.225029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.225029] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.225951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.226419] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.226473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.226555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.226861] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.226977] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.227143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.227312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.227508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.227590] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 513bf757-dc94-4c93-81c5-d4589e55c0a8 is going to be updated. [ 1185.251318] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.251507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.251602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.251854] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.252101] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.252303] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-513bf757-dc94-4c93-81c5-d4589e55c0a8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.365553] env[65992]: INFO networking_nsxv3.common.synchronization [req-f5f879de-b5d7-43be-9127-1f3b6d7a7a28 req-97f71034-8f6f-4283-86fe-cf4f910ab209 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1185.365980] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1185.366309] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.366449] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.366515] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.366761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.366931] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.371031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.371031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.371031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.371031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.371031] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.729712] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.732393] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.733112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.733112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.733112] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.733451] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.733451] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.733541] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.733881] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.733881] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.734097] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.734241] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.734369] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.734479] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.734599] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.734773] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.734907] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.753149] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.753335] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1185.753468] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.753635] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.754057] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-883ba482-6cac-40c9-98df-0ba77fd0cb5a taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.754255] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-883ba482-6cac-40c9-98df-0ba77fd0cb5a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.754374] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-883ba482-6cac-40c9-98df-0ba77fd0cb5a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.754683] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-883ba482-6cac-40c9-98df-0ba77fd0cb5a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.754818] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883ba482-6cac-40c9-98df-0ba77fd0cb5a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.873950] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.874127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.874195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.874426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.874518] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.874753] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.874857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.874857] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.875013] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.875090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.875173] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c719830-8963-41da-a846-e107a5d18360 already deleted. [ 1185.875251] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.237747] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.237747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.237747] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.238118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.238178] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.238251] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5147b71-0080-456f-8195-21323de6a67d is going to be created. [ 1186.257096] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.257405] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.257455] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.257699] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.257881] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.258070] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port 883ba482-6cac-40c9-98df-0ba77fd0cb5a not found, creating... [ 1186.258307] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.258462] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.258574] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.258796] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.258928] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.259214] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.259375] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.259477] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.259678] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.259807] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.260108] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: 883ba482-6cac-40c9-98df-0ba77fd0cb5a is going to be created. [ 1186.262713] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.262834] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.262918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.263056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.263206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.271493] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5147b71-0080-456f-8195-21323de6a67d in Status: UNINITIALIZED for 2s [ 1186.278387] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.278578] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.278692] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.278940] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.279171] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.279388] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-883ba482-6cac-40c9-98df-0ba77fd0cb5a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.017830] env[65992]: INFO networking_nsxv3.common.synchronization [req-f5f879de-b5d7-43be-9127-1f3b6d7a7a28 req-aecc20c3-3857-45e9-9f46-5bec1956c407 service nova] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_rules [ 1187.018112] env[65992]: INFO networking_nsxv3.common.synchronization [req-f5f879de-b5d7-43be-9127-1f3b6d7a7a28 req-aecc20c3-3857-45e9-9f46-5bec1956c407 service nova] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1187.018257] env[65992]: INFO networking_nsxv3.common.synchronization [req-f5f879de-b5d7-43be-9127-1f3b6d7a7a28 req-aecc20c3-3857-45e9-9f46-5bec1956c407 service nova] Enqueued Resource ID: 883ba482-6cac-40c9-98df-0ba77fd0cb5a with Priority: HIGHEST for action port [ 1187.018717] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_rules [ 1187.018855] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1187.018954] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 883ba482-6cac-40c9-98df-0ba77fd0cb5a with Priority: HIGHEST for action port [ 1187.019249] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.019361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.019445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.019654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.019725] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.020601] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.020931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.020931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.020931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.021149] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.021211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.021211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.021373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.021478] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.022057] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.022428] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-883ba482-6cac-40c9-98df-0ba77fd0cb5a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.022520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-883ba482-6cac-40c9-98df-0ba77fd0cb5a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.022567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-883ba482-6cac-40c9-98df-0ba77fd0cb5a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.022688] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-883ba482-6cac-40c9-98df-0ba77fd0cb5a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.022758] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883ba482-6cac-40c9-98df-0ba77fd0cb5a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.525552] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.526621] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.526738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.526897] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 883ba482-6cac-40c9-98df-0ba77fd0cb5a with status ACTIVE [ 1187.527063] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.527171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.527235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.527439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.527526] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.527692] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.527788] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.527847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.528010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.528092] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.528268] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.528360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.528420] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.528554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.528626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.528706] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 883ba482-6cac-40c9-98df-0ba77fd0cb5a is going to be updated. [ 1187.550516] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.550729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.550729] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.550988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.551142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.551318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-883ba482-6cac-40c9-98df-0ba77fd0cb5a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.031100] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.282344] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5147b71-0080-456f-8195-21323de6a67d in Status: SUCCESS [ 1188.282344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.282528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.282741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.282948] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.283451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.283451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.283451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.283583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.283630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.283719] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.533891] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.534280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.534416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.534612] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.534705] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.534809] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c719830-8963-41da-a846-e107a5d18360 is going to be created. [ 1188.561705] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.561988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.562091] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.562363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.562572] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.573568] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: UNINITIALIZED for 2s [ 1188.785773] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.287889] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5147b71-0080-456f-8195-21323de6a67d: rpc.has_security_group_logging(os_id): False [ 1189.321628] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.322059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.322059] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.322259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.322497] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.322887] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.323131] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.323276] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.323534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.323698] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.323801] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5147b71-0080-456f-8195-21323de6a67d is going to be created. [ 1189.412471] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.412725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.412725] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.413021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.413291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.425848] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5147b71-0080-456f-8195-21323de6a67d in Status: IN_PROGRESS for 2s [ 1190.585698] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: SUCCESS [ 1190.586221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.586506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.586841] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.587209] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.587428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.587557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.587802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.587953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.588135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.588291] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.090879] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.440916] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5147b71-0080-456f-8195-21323de6a67d in Status: SUCCESS [ 1191.441191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.592942] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c719830-8963-41da-a846-e107a5d18360: rpc.has_security_group_logging(os_id): False [ 1191.610854] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.611030] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.611080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.611288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.611455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.611616] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.611714] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.611774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.611912] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.612068] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.612155] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c719830-8963-41da-a846-e107a5d18360 is going to be created. [ 1191.673761] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.673960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.673960] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.674212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.674426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.685867] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: IN_PROGRESS for 2s [ 1192.020257] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1192.020362] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1192.619672] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-926 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.620047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.620047] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.620282] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.620540] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.620696] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.620811] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.621175] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.621357] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.621568] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1192.621681] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1192.621789] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1192.621894] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1192.622029] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1192.622147] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1192.622281] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1192.652044] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1192.652241] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1192.652468] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1192.652660] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-926" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.653052] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-c2e6cb5f-e08e-4f00-ae08-def75538b547 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.653283] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.653447] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.653773] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.653917] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2e6cb5f-e08e-4f00-ae08-def75538b547',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.156758] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.156996] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.157137] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.157494] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.157656] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.157946] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.158126] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.158242] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.158461] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.158618] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.158914] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.159154] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.159367] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.159592] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.159726] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.159870] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: c2e6cb5f-e08e-4f00-ae08-def75538b547 is going to be updated. [ 1193.183293] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.183510] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.183631] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.183905] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.184106] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.184340] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.699181] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: SUCCESS [ 1193.699555] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.930696] env[65992]: INFO networking_nsxv3.common.synchronization [req-6cb19995-7579-44cf-8b64-49d069115d3d req-39153dad-f6ba-46ea-a2b8-d037302e234b service nova] Enqueued Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_rules [ 1193.930892] env[65992]: INFO networking_nsxv3.common.synchronization [req-6cb19995-7579-44cf-8b64-49d069115d3d req-39153dad-f6ba-46ea-a2b8-d037302e234b service nova] Enqueued Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_members [ 1193.931044] env[65992]: INFO networking_nsxv3.common.synchronization [req-6cb19995-7579-44cf-8b64-49d069115d3d req-39153dad-f6ba-46ea-a2b8-d037302e234b service nova] Enqueued Resource ID: c2e6cb5f-e08e-4f00-ae08-def75538b547 with Priority: HIGHEST for action port [ 1193.931611] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_rules [ 1193.932026] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_members [ 1193.932026] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2e6cb5f-e08e-4f00-ae08-def75538b547 with Priority: HIGHEST for action port [ 1193.934632] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.934632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.934632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.934632] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.934632] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.935144] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.935521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.935521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.935577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.936400] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.936400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.936400] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.936602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.936602] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.936820] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.937942] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2e6cb5f-e08e-4f00-ae08-def75538b547 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.938152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.938249] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.938439] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.941612] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2e6cb5f-e08e-4f00-ae08-def75538b547',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.441684] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.442918] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.443072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.443274] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2e6cb5f-e08e-4f00-ae08-def75538b547 with status ACTIVE [ 1194.443420] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.443601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.443601] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.443809] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.443894] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.444088] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.444176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.444242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.444399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.444486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.444669] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.444804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.444804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.445280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.445280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.445620] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2e6cb5f-e08e-4f00-ae08-def75538b547 is going to be updated. [ 1194.469956] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.470207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.470207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.470367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.470426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.470607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2e6cb5f-e08e-4f00-ae08-def75538b547" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.948983] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.451824] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.452824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.452936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.453288] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.453427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.453604] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb is going to be updated. [ 1195.499143] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.500036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.500036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.500036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.500036] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.517427] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: IN_PROGRESS for 2s [ 1196.229399] env[65992]: INFO networking_nsxv3.common.synchronization [req-eb25a919-e221-4688-b2e8-61475e3cff7d req-17e0a3f8-b12a-48d7-acbf-39973bcd6b58 tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 1196.229399] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 1196.229399] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.229399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.229399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.229399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.232846] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.232846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.232846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.232846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.232846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.232846] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.736046] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.239905] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.529143] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: SUCCESS [ 1197.529389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.529562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.529778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.530041] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.530142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.530212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.530376] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.530455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.530539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.530626] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.743918] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.744409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.744568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.744942] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.749021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.749021] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be updated. [ 1197.778062] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.778252] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.778321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.778523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.778701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.789594] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: IN_PROGRESS for 2s [ 1197.864857] env[65992]: INFO networking_nsxv3.common.synchronization [req-34ec0ab4-48c4-4686-8610-723e49421882 req-c9568fa7-e922-4779-b01f-d49189f556b3 tempest-AttachVolumeTestJSON-243931194 tempest-AttachVolumeTestJSON-243931194-project-member] Enqueued Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_members [ 1197.865461] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGHEST for action security_group_members [ 1197.865776] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763682a6-c9f9-4906-bec2-c14372760919 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.866890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.866890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.866890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.866890] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.866890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.866890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.866890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.866890] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.867467] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.033895] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.369339] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.369754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.369754] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.369843] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.370344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.370344] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.370344] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.370552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.370552] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.370617] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.370700] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763682a6-c9f9-4906-bec2-c14372760919 is going to be updated. [ 1198.403582] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.403816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.403918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.404779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.405298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.417820] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763682a6-c9f9-4906-bec2-c14372760919 in Status: IN_PROGRESS for 2s [ 1198.537554] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b680e30-6d7d-4efa-b160-f9820a859bcb: rpc.has_security_group_logging(os_id): False [ 1198.560937] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.560937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.560937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.560937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.560937] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.560937] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.561399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.561399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.561399] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.561508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.561550] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb is going to be updated. [ 1198.624597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.624798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.624798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.625086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.625167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.647331] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: IN_PROGRESS for 2s [ 1199.800624] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 1199.801112] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.431671] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763682a6-c9f9-4906-bec2-c14372760919 in Status: SUCCESS [ 1200.431891] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763682a6-c9f9-4906-bec2-c14372760919 deletion is rescheduled due to dependency. [ 1200.431955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.663287] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: SUCCESS [ 1200.663549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.468299] env[65992]: INFO networking_nsxv3.common.synchronization [req-0a580001-db43-41b3-8d2d-5a4ba2bddc2e req-b85b03aa-751b-4210-aafa-04674f17ac33 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1201.468299] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1201.469109] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.469109] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.469109] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.469269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.470211] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.470211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.470211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.470211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.470211] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.470211] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.816033] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.816033] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.816033] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.816033] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.816348] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.816414] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.816561] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.816816] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.816996] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.817264] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.817404] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.817528] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.817662] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.817791] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.817950] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.818135] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.841554] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.841771] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1201.841929] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.842144] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.842543] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-18a714f6-9afa-4bf8-bb80-699441ce68db taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.842762] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-18a714f6-9afa-4bf8-bb80-699441ce68db" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.842893] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-18a714f6-9afa-4bf8-bb80-699441ce68db" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.843292] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-18a714f6-9afa-4bf8-bb80-699441ce68db" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.843471] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a714f6-9afa-4bf8-bb80-699441ce68db',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.972694] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.346837] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.346837] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.346837] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.347258] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.347258] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.347414] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 18a714f6-9afa-4bf8-bb80-699441ce68db not found, creating... [ 1202.347689] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.347903] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.348061] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.348315] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.348454] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.348758] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.348919] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.349061] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.349289] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.349493] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.349682] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 18a714f6-9afa-4bf8-bb80-699441ce68db is going to be created. [ 1202.373372] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.373603] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.373730] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.374014] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.374245] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.374488] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-18a714f6-9afa-4bf8-bb80-699441ce68db" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.475169] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.978337] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.978520] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.978584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.979149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.979149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.979149] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c719830-8963-41da-a846-e107a5d18360 is going to be updated. [ 1203.010218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.010367] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.010451] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.010723] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.010886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.020914] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: IN_PROGRESS for 2s [ 1203.099781] env[65992]: INFO networking_nsxv3.common.synchronization [req-0a580001-db43-41b3-8d2d-5a4ba2bddc2e req-ce65bd14-17ad-434e-bb33-86d78aa9f342 service nova] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_rules [ 1203.099959] env[65992]: INFO networking_nsxv3.common.synchronization [req-0a580001-db43-41b3-8d2d-5a4ba2bddc2e req-ce65bd14-17ad-434e-bb33-86d78aa9f342 service nova] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1203.100114] env[65992]: INFO networking_nsxv3.common.synchronization [req-0a580001-db43-41b3-8d2d-5a4ba2bddc2e req-ce65bd14-17ad-434e-bb33-86d78aa9f342 service nova] Enqueued Resource ID: 18a714f6-9afa-4bf8-bb80-699441ce68db with Priority: HIGHEST for action port [ 1203.100692] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_rules [ 1203.100834] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1203.100931] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18a714f6-9afa-4bf8-bb80-699441ce68db with Priority: HIGHEST for action port [ 1203.101315] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.101408] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.101468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.101650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.101774] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.102870] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.102870] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.103090] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-18a714f6-9afa-4bf8-bb80-699441ce68db taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.103090] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18a714f6-9afa-4bf8-bb80-699441ce68db" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.103239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18a714f6-9afa-4bf8-bb80-699441ce68db" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.103318] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18a714f6-9afa-4bf8-bb80-699441ce68db" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.103442] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a714f6-9afa-4bf8-bb80-699441ce68db',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.605401] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.605816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.605862] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18a714f6-9afa-4bf8-bb80-699441ce68db with status ACTIVE [ 1203.606115] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.606291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.606455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.606903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.607050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.607303] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.607454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.607549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.607787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.607905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.608190] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.608334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.608427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.608658] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.608785] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.608914] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18a714f6-9afa-4bf8-bb80-699441ce68db is going to be updated. [ 1203.633692] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.633926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.633926] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.634213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.634377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.634565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18a714f6-9afa-4bf8-bb80-699441ce68db" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.033033] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: SUCCESS [ 1205.033357] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.034592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.034592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.034592] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.034592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.034592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.034592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.034845] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.034845] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.538137] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.041087] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.543998] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.544213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.544285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.544508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.544597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.544814] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c719830-8963-41da-a846-e107a5d18360 is going to be updated. [ 1206.578421] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.578591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.578654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.578865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.579050] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.591118] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: IN_PROGRESS for 2s [ 1207.518390] env[65992]: INFO networking_nsxv3.common.synchronization [req-c9ce91cd-5dee-4005-8dd3-b5d376379ec7 req-99939bd4-cf07-4e67-819e-68bc6983e210 tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1207.518940] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1207.519251] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.519373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.519440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.519634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.520675] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.520675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.520675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.520675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.520675] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.520675] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.022642] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.022880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.022880] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.023107] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.023212] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.023417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.023522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.023621] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.023780] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.023860] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.023944] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1208.055328] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.055556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.055556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.055764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.055900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.065444] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1208.602115] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: SUCCESS [ 1208.602586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.602884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.603163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.603417] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.603580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.603630] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.603798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.603904] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.604063] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.604191] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.106981] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.610281] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c719830-8963-41da-a846-e107a5d18360: rpc.has_security_group_logging(os_id): False [ 1209.628423] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.628646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.628646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.628844] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.628931] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.629258] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.629467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.629587] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.629744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.629836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.629905] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c719830-8963-41da-a846-e107a5d18360 is going to be updated. [ 1209.690721] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.690924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.691019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.691281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.691562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.708127] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: IN_PROGRESS for 2s [ 1210.075467] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1210.075467] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 deletion is rescheduled due to dependency. [ 1210.075467] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.724468] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: SUCCESS [ 1211.724468] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.219513] env[65992]: INFO networking_nsxv3.common.synchronization [None req-c65f261b-a507-4ca8-b424-b43d68dd9140 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1212.223462] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1212.223462] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.223462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.223462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.223462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.223462] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.223462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.223462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.224411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.224411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.225343] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.728383] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.728695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.728695] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.729115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.729196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.729455] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.729628] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.729726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.729940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.730042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.730159] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1212.759830] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.760465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.760560] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.760758] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.760900] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.771811] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1214.784593] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1214.784964] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 deletion is rescheduled due to dependency. [ 1214.785045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.135085] env[65992]: INFO networking_nsxv3.common.synchronization [req-55be0114-d578-4492-aa61-8e22bff0b19d req-32e57442-3cb8-474c-8622-b841c613800e tempest-ServerActionsTestOtherA-2120508532 tempest-ServerActionsTestOtherA-2120508532-project-member] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 1215.135447] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGHEST for action security_group_members [ 1215.135791] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.135916] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.136053] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.136190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.136375] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.136495] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.136554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.136697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.136778] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.136866] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.641596] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.641796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.641842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.642070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.642164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.642442] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.642573] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.642644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.642847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.642927] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.643026] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be updated. [ 1215.672792] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.672955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.673088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.673296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.673563] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.682201] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: IN_PROGRESS for 2s [ 1216.947916] env[65992]: INFO networking_nsxv3.common.synchronization [req-10c5eda3-ed2d-4014-963c-d5f6818335ad req-1f8b3715-94bb-484a-8b95-d7a5ddd0260d tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1216.948307] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1216.948781] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.948933] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.949016] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.949299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.949527] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.949670] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.949765] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.949979] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.950334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.950334] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.277488] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.278349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.278349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.278349] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.278349] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.278623] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.278623] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.278764] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.278913] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.279328] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.279536] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.279667] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.279832] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.279892] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.280046] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.280219] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.306415] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.306563] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1217.306673] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.306843] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-279" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.307272] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.307272] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.307272] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.307926] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.308092] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5e6ea55-b1f4-43d5-ad57-e036e4bf775b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.452544] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.452761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.452761] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.452964] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.453080] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.453344] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.453507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.453595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.453779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.453888] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.454015] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1217.480898] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.481247] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.481385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.481559] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.481686] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.491010] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1217.692249] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58a9088b-471e-48ab-8bf1-877d11c93872 in Status: SUCCESS [ 1217.692522] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 deletion is rescheduled due to dependency. [ 1217.692700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.811231] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.811765] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.811765] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.812207] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.812459] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.812670] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port a5e6ea55-b1f4-43d5-ad57-e036e4bf775b not found, creating... [ 1217.812953] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.813132] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.813246] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.813480] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.813617] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.813906] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.814071] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.814186] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.814431] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.814568] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.814820] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: a5e6ea55-b1f4-43d5-ad57-e036e4bf775b is going to be created. [ 1217.835751] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.835993] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.836186] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.836486] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.836763] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.837040] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.565098] env[65992]: INFO networking_nsxv3.common.synchronization [req-10c5eda3-ed2d-4014-963c-d5f6818335ad req-5e78c140-72bb-4fd3-8aed-adf6b51b3723 service nova] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 1218.565344] env[65992]: INFO networking_nsxv3.common.synchronization [req-10c5eda3-ed2d-4014-963c-d5f6818335ad req-5e78c140-72bb-4fd3-8aed-adf6b51b3723 service nova] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1218.565439] env[65992]: INFO networking_nsxv3.common.synchronization [req-10c5eda3-ed2d-4014-963c-d5f6818335ad req-5e78c140-72bb-4fd3-8aed-adf6b51b3723 service nova] Enqueued Resource ID: a5e6ea55-b1f4-43d5-ad57-e036e4bf775b with Priority: HIGHEST for action port [ 1218.565881] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_rules [ 1218.566031] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1218.566131] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5e6ea55-b1f4-43d5-ad57-e036e4bf775b with Priority: HIGHEST for action port [ 1218.566399] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.566519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.566584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.566779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.566860] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.567978] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.567978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.567978] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.568195] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.568384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.568562] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.569709] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5e6ea55-b1f4-43d5-ad57-e036e4bf775b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.071557] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.071703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.071896] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5e6ea55-b1f4-43d5-ad57-e036e4bf775b with status ACTIVE [ 1219.072083] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.072196] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.072261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.072504] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.072652] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.072814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.072878] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.072939] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.073106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.073180] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.073362] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.073454] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.073512] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.073991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.073991] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.073991] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5e6ea55-b1f4-43d5-ad57-e036e4bf775b is going to be updated. [ 1219.094698] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.094862] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.094969] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.095148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.095285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.095506] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5e6ea55-b1f4-43d5-ad57-e036e4bf775b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.502151] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1219.502379] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 deletion is rescheduled due to dependency. [ 1219.502540] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.502755] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.503061] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.503272] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.503428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.503544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.503694] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.503777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.503902] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.006797] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.509226] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.011665] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.011956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.011956] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.012129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.012223] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.012388] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1221.045464] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.045654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.045654] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.045871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.046052] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.054921] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1223.066610] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1223.066924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.066995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.067358] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.067655] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.067795] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.067864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.068056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.068142] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.068229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.068317] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.567775] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.567880] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1223.570402] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.692868] env[65992]: INFO networking_nsxv3.common.synchronization [req-2e96c80a-d84d-476c-81f1-7f563be787d8 req-2c8715b5-48be-4495-88f8-af7fe3210ca1 tempest-ServerRescueNegativeTestJSON-1377566600 tempest-ServerRescueNegativeTestJSON-1377566600-project-member] Enqueued Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_members [ 1223.693531] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGHEST for action security_group_members [ 1223.693876] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-b680f30c-1e44-4a84-83f2-ddbc61e8000b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.694010] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.694113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.694323] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.694488] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.694592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.694724] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.694837] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.694881] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.694966] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.073558] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92df56c0-4890-4336-9656-3c0ad1e3b068: rpc.has_security_group_logging(os_id): False [ 1224.093207] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.093473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.093575] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.093842] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.093949] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.094271] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.094398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.094472] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.094669] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.094774] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.094873] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1224.151699] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.152111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.152111] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.152202] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.152285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.167387] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1224.197081] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.197190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.197190] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.197928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.197928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.197928] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.197928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.197928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.198114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.198114] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.198114] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b is going to be updated. [ 1224.232172] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.232307] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.232432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.232649] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.232793] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.255505] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b in Status: IN_PROGRESS for 2s [ 1225.318960] env[65992]: INFO networking_nsxv3.common.synchronization [None req-efbe13fe-fd22-495f-ada7-6ece3bfe7871 None None] Enqueued Resource ID: 146fab03-75e0-45a1-a812-980917f32610 with Priority: HIGHEST for action port [ 1225.319710] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 146fab03-75e0-45a1-a812-980917f32610 with Priority: HIGHEST for action port [ 1225.320212] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-146fab03-75e0-45a1-a812-980917f32610 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.320426] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-146fab03-75e0-45a1-a812-980917f32610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.320527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-146fab03-75e0-45a1-a812-980917f32610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.321295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-146fab03-75e0-45a1-a812-980917f32610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.321460] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('146fab03-75e0-45a1-a812-980917f32610',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.824236] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 146fab03-75e0-45a1-a812-980917f32610 [ 1225.824509] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.824700] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.824792] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.825060] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.825185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.825301] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:146fab03-75e0-45a1-a812-980917f32610 already deleted. [ 1225.825405] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-146fab03-75e0-45a1-a812-980917f32610" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.185766] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1226.185766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.265146] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b in Status: SUCCESS [ 1226.265326] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b deletion is rescheduled due to dependency. [ 1226.265460] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.139408] env[65992]: INFO networking_nsxv3.common.synchronization [None req-b3613f29-60b4-4af6-a45a-d77d4133d561 None None] Enqueued Resource ID: a65df1cf-c160-44dc-8cb8-20035ea047ee with Priority: HIGHEST for action port [ 1228.140149] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65df1cf-c160-44dc-8cb8-20035ea047ee with Priority: HIGHEST for action port [ 1228.140291] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-a65df1cf-c160-44dc-8cb8-20035ea047ee taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.140435] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a65df1cf-c160-44dc-8cb8-20035ea047ee" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.140499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a65df1cf-c160-44dc-8cb8-20035ea047ee" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.140753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a65df1cf-c160-44dc-8cb8-20035ea047ee" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.140830] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a65df1cf-c160-44dc-8cb8-20035ea047ee',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.644127] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a65df1cf-c160-44dc-8cb8-20035ea047ee [ 1228.644127] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.644127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.644127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.644388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.644388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.644470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a65df1cf-c160-44dc-8cb8-20035ea047ee already deleted. [ 1228.644557] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a65df1cf-c160-44dc-8cb8-20035ea047ee" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.899727] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.899727] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.899727] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.899947] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.900241] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.900568] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.900717] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.900968] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.901587] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.901587] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.901587] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.901587] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.901759] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.901759] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.901910] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.902282] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1228.923620] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1228.923867] env[65992]: DEBUG dogpile.cache.region [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1228.924030] env[65992]: DEBUG dogpile.lock [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1228.924204] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.924520] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.924691] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.924811] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.925153] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.925280] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58229ca-5c52-46e6-b5c4-43c5acdf59a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.427616] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.428045] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.428045] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.428420] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.428610] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.428791] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Segment Port e58229ca-5c52-46e6-b5c4-43c5acdf59a0 not found, creating... [ 1229.429109] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.429313] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.429436] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.429684] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.429823] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.430112] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.430265] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.430404] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.430614] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.430744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.430876] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Resource: SegmentPort with ID: e58229ca-5c52-46e6-b5c4-43c5acdf59a0 is going to be created. [ 1229.453995] env[65992]: DEBUG networking_nsxv3.common.locking [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.454279] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.454456] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.454766] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.455041] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.455306] env[65992]: DEBUG oslo_concurrency.lockutils [None req-32cf84bc-43fb-4f28-8f0f-ba2ad4da7d44 None None] Releasing lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.151368] env[65992]: INFO networking_nsxv3.common.synchronization [req-56079448-4d32-43d9-8b58-1ffd71dcaa6e req-239e0de8-6677-48d2-b5a9-34587c4a695f service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1230.151624] env[65992]: INFO networking_nsxv3.common.synchronization [req-56079448-4d32-43d9-8b58-1ffd71dcaa6e req-239e0de8-6677-48d2-b5a9-34587c4a695f service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1230.151722] env[65992]: INFO networking_nsxv3.common.synchronization [req-56079448-4d32-43d9-8b58-1ffd71dcaa6e req-239e0de8-6677-48d2-b5a9-34587c4a695f service nova] Enqueued Resource ID: e58229ca-5c52-46e6-b5c4-43c5acdf59a0 with Priority: HIGHEST for action port [ 1230.152378] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1230.152568] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1230.152869] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58229ca-5c52-46e6-b5c4-43c5acdf59a0 with Priority: HIGHEST for action port [ 1230.153126] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.153268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.153360] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.153556] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.153613] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.154472] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.155238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.155238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.155238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.155238] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.155238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.155238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.155539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.155539] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.155691] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.156618] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.156618] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.156732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.156871] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.156871] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58229ca-5c52-46e6-b5c4-43c5acdf59a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.305609] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac8afeba-0a2b-476a-b5fe-53decdb2f80e req-b6febf42-491d-4bb1-b44a-8e3313f74659 tempest-ServerAddressesTestJSON-1428681872 tempest-ServerAddressesTestJSON-1428681872-project-member] Enqueued Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGHEST for action security_group_members [ 1230.306192] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGHEST for action security_group_members [ 1230.306498] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.306624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.306689] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.306947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.307547] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.307668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.307732] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.307899] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.308058] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.308185] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.599319] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-577 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.599565] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-577" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.599635] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-577" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.600021] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-577" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.600219] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.600376] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.600489] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.600698] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.600868] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.601089] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1230.601202] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.601310] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.601419] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.601528] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1230.601634] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.601831] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.622430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.622643] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1230.622795] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.622969] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-577" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.623294] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.623468] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.623607] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.623927] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.624076] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed3c1f5a-d1f1-4cb4-a782-f71f108f1230',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.658835] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.659064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.659148] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.660031] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e58229ca-5c52-46e6-b5c4-43c5acdf59a0 with status ACTIVE [ 1230.660210] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.660411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.660619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.660707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.660757] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.660962] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.661073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.661113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.661243] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.661329] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.661497] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.661591] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.661647] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.662283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.662283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.662283] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e58229ca-5c52-46e6-b5c4-43c5acdf59a0 is going to be updated. [ 1230.686045] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.686265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.686265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.686388] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.686522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.686690] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.810218] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.810473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.810473] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.810730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.810859] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.811097] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.811208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.811314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.811509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.811609] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.811726] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c already deleted. [ 1230.811828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.126714] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.127029] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.127203] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.127554] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.127755] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.127918] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port ed3c1f5a-d1f1-4cb4-a782-f71f108f1230 not found, creating... [ 1231.128222] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.128387] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.128499] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.128734] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.128868] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.129169] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.129325] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.129440] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.129649] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.129778] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.129914] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: ed3c1f5a-d1f1-4cb4-a782-f71f108f1230 is going to be created. [ 1231.153802] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.154062] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.154223] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.154546] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.154833] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.155106] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.164067] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.667185] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.667528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.667528] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.667664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.667701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.667807] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1231.713272] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.713595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.713595] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.713813] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.713903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.736390] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1231.887737] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac8afeba-0a2b-476a-b5fe-53decdb2f80e req-f65759f8-efbf-4363-a8b0-ccf5a2958a84 service nova] Enqueued Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGHEST for action security_group_rules [ 1231.887791] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac8afeba-0a2b-476a-b5fe-53decdb2f80e req-f65759f8-efbf-4363-a8b0-ccf5a2958a84 service nova] Enqueued Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGHEST for action security_group_members [ 1231.887919] env[65992]: INFO networking_nsxv3.common.synchronization [req-ac8afeba-0a2b-476a-b5fe-53decdb2f80e req-f65759f8-efbf-4363-a8b0-ccf5a2958a84 service nova] Enqueued Resource ID: ed3c1f5a-d1f1-4cb4-a782-f71f108f1230 with Priority: HIGHEST for action port [ 1231.888481] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGHEST for action security_group_rules [ 1231.888613] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGHEST for action security_group_members [ 1231.888707] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed3c1f5a-d1f1-4cb4-a782-f71f108f1230 with Priority: HIGHEST for action port [ 1231.888978] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.889285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.889355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.889615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.889698] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.890964] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.891227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.891314] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.891499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.891652] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.891856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.891856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.891992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.892035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.892129] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.893559] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.894507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.894507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.894507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.894507] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed3c1f5a-d1f1-4cb4-a782-f71f108f1230',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.395791] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.398829] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.398829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.399212] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed3c1f5a-d1f1-4cb4-a782-f71f108f1230 with status ACTIVE [ 1232.399250] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.399455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.399455] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.399770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.399770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.399905] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.400513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.400513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.400513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.400643] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.400741] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.400925] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.401023] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.401185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.401261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.401344] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed3c1f5a-d1f1-4cb4-a782-f71f108f1230 is going to be updated. [ 1232.431542] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.431786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.431786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.432031] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.432166] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.432332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed3c1f5a-d1f1-4cb4-a782-f71f108f1230" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.904089] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.408088] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.408088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.408088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.408088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.408088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.408088] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c is going to be created. [ 1233.433858] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.434088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.434139] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.434315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.434466] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.445477] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c in Status: UNINITIALIZED for 2s [ 1233.747204] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1233.747583] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.747855] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.748204] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.748513] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.748711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.748815] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.749606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.749726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.749884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.750145] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.252578] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.252997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.252997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.253093] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.253349] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.253501] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.253662] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.253869] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.253984] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.254135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.254394] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.254469] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.254509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.254678] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.254871] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.254989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.255066] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.255209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.255283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.255363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.255485] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.655801] env[65992]: INFO networking_nsxv3.common.synchronization [req-f8377eee-8bd1-447e-864f-e4d9b8e55cd9 req-dbc294c2-0a90-4837-bb79-620971f41301 tempest-ServerRescueNegativeTestJSON-1377566600 tempest-ServerRescueNegativeTestJSON-1377566600-project-member] Enqueued Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1234.656348] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1234.657313] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.657313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.657465] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.657585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.657760] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.657861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.657988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.658113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.658175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.658254] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.759085] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a25c9a9c-e9a8-445f-ad80-439686ed1021: rpc.has_security_group_logging(os_id): False [ 1234.779114] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.779285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.779384] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.779566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.779655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.779883] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.779983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.780057] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.780209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.780415] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.780486] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.780582] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.780644] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.780784] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.780856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.781052] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.781149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.781207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.781343] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.781414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.781499] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1234.847541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.847733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.847850] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.848077] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.848227] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.860850] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1235.159888] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.457738] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c in Status: SUCCESS [ 1235.458075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.458220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.458522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.458715] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.458861] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.458936] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.459152] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.459271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.459380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.459503] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.662050] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.964229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.964229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.964229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.964229] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.964229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.965086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.965086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.965086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.965086] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.965086] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.164930] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.165162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.165273] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.165510] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.165606] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.165727] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 is going to be updated. [ 1236.198086] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.198327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.198327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.198535] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.198683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.209684] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: IN_PROGRESS for 2s [ 1236.467409] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 763a8bb4-e723-4b5a-82e4-e15be73f1f0c: rpc.has_security_group_logging(os_id): False [ 1236.486115] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.486322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.486322] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.486554] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.486707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.486942] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.487095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.487164] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.487356] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.487437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.487644] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.488499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.488499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.488499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.488499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.488499] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.488499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.488499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.488818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.488818] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.488818] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c is going to be created. [ 1236.544748] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.544983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.544983] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.545198] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.545375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.556283] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c in Status: IN_PROGRESS for 2s [ 1236.874954] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1236.875262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.230035] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: SUCCESS [ 1238.230035] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.568238] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c in Status: SUCCESS [ 1238.568482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.657564] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1239.657909] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1242.037056] env[65992]: INFO networking_nsxv3.common.synchronization [req-9fca75dc-d277-49e2-9ab6-d438fd6e107f req-2f80a18b-a924-4c2c-b3d3-1ff4627965d5 tempest-ServerRescueNegativeTestJSON-1377566600 tempest-ServerRescueNegativeTestJSON-1377566600-project-member] Enqueued Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1242.037056] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 with Priority: HIGHEST for action security_group_members [ 1242.037056] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-50f8b602-7d1f-4e01-aba4-88750c95b873 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.037056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.037056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.037056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.037056] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.037056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.037056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.037056] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.037571] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.037571] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50f8b602-7d1f-4e01-aba4-88750c95b873',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.539646] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.539646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.539646] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.539908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.539908] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.540039] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.540207] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.540281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.540477] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.540550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.540639] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 is going to be updated. [ 1242.570060] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.570278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.570278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.570395] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.570542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.584560] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: IN_PROGRESS for 2s [ 1242.942540] env[65992]: INFO networking_nsxv3.common.synchronization [req-10f8dc19-dba6-4022-bf2c-66b6883d54bf req-ddc10082-6b86-42eb-b0a5-973a222b2022 tempest-ServerAddressesTestJSON-1428681872 tempest-ServerAddressesTestJSON-1428681872-project-member] Enqueued Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGHEST for action security_group_members [ 1242.942866] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGHEST for action security_group_members [ 1242.943184] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.943311] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.943377] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.943615] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.943733] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.943826] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.943885] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.944043] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.944127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.944217] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.447113] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.447113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.447113] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.447597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.447597] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.447597] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.447701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.447701] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.447838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.447934] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.447975] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c is going to be updated. [ 1243.477955] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.478200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.478279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.479051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.479051] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.489489] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c in Status: IN_PROGRESS for 2s [ 1244.595075] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 in Status: SUCCESS [ 1244.595403] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50f8b602-7d1f-4e01-aba4-88750c95b873 deletion is rescheduled due to dependency. [ 1244.595403] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50f8b602-7d1f-4e01-aba4-88750c95b873" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.498993] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c in Status: SUCCESS [ 1245.499243] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c deletion is rescheduled due to dependency. [ 1245.499363] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.564033] env[65992]: INFO networking_nsxv3.common.synchronization [req-98b6c2ec-3781-470e-91c0-00141463d6b2 req-396ed369-e594-4e4f-b70d-ad3eed98fe80 tempest-AttachVolumeShelveTestJSON-1466192988 tempest-AttachVolumeShelveTestJSON-1466192988-project-member] Enqueued Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_members [ 1245.564584] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb with Priority: HIGHEST for action security_group_members [ 1245.564905] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b680e30-6d7d-4efa-b160-f9820a859bcb taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.567342] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.567513] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.567898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.568180] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.568372] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.568440] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.568738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.568738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.568839] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b680e30-6d7d-4efa-b160-f9820a859bcb',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.073383] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.073779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.073779] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.073877] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.074028] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.074146] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.074241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.074296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.074569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.074569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.074685] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb is going to be updated. [ 1246.125033] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.125033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.125033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.125033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.125033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.134202] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: IN_PROGRESS for 2s [ 1246.505264] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.505490] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.505613] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.505907] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.506202] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.506470] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.506513] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.506723] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.506876] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.507104] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.507226] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.507335] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.507456] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.507578] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.507706] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.507842] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.526097] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.526271] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1246.527864] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.527864] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-950" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.527864] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.527864] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.527864] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.527864] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.527864] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58229ca-5c52-46e6-b5c4-43c5acdf59a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.030272] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.030636] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.030833] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.031225] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.031472] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.031922] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.032221] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.032468] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.032764] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.032933] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.033359] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.033604] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.033672] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.034273] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.034273] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.034273] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: e58229ca-5c52-46e6-b5c4-43c5acdf59a0 is going to be updated. [ 1247.057460] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.057460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.057460] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.057658] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.058071] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.058071] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.304273] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1247.304538] env[65992]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-72b3aee0-f21c-40e2-8818-1531c6395e40 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1247.773460] env[65992]: INFO networking_nsxv3.common.synchronization [req-8cc62178-55ca-4122-8423-1c382a06ae04 req-a9542afe-5bcf-4bd9-8c52-95c36eb3a4e9 service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1247.773741] env[65992]: INFO networking_nsxv3.common.synchronization [req-8cc62178-55ca-4122-8423-1c382a06ae04 req-a9542afe-5bcf-4bd9-8c52-95c36eb3a4e9 service nova] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1247.773852] env[65992]: INFO networking_nsxv3.common.synchronization [req-8cc62178-55ca-4122-8423-1c382a06ae04 req-a9542afe-5bcf-4bd9-8c52-95c36eb3a4e9 service nova] Enqueued Resource ID: e58229ca-5c52-46e6-b5c4-43c5acdf59a0 with Priority: HIGHEST for action port [ 1247.774489] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_rules [ 1247.774810] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1247.774948] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58229ca-5c52-46e6-b5c4-43c5acdf59a0 with Priority: HIGHEST for action port [ 1247.775244] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.775373] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.775446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.775650] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.775738] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.776985] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.777118] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.777479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.777766] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.779397] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.779397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.779397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.779397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.779397] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.779397] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.781041] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.781041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.781041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.781041] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.781041] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e58229ca-5c52-46e6-b5c4-43c5acdf59a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.154841] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb in Status: SUCCESS [ 1248.155180] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b680e30-6d7d-4efa-b160-f9820a859bcb deletion is rescheduled due to dependency. [ 1248.155297] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b680e30-6d7d-4efa-b160-f9820a859bcb" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.281611] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.282931] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.283067] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.283231] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e58229ca-5c52-46e6-b5c4-43c5acdf59a0 with status ACTIVE [ 1248.283401] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.283525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.283641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.283924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.284074] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.284316] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.284427] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.284505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.284721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.286226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.286517] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.286655] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.286706] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.286865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.286947] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.287113] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e58229ca-5c52-46e6-b5c4-43c5acdf59a0 is going to be updated. [ 1248.308056] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.308462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.308462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.308462] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.308584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.308730] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e58229ca-5c52-46e6-b5c4-43c5acdf59a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.789798] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.292056] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.292238] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.292309] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.292527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.292619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.292846] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1249.324957] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.325321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.325321] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.325452] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.325726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.334981] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1249.740945] env[65992]: INFO networking_nsxv3.common.synchronization [req-24fd9869-51aa-4fc6-9697-5962c3b3621a req-22e7e700-d4e4-4113-b7d4-54b2d39322a7 tempest-AttachVolumeNegativeTest-2017791131 tempest-AttachVolumeNegativeTest-2017791131-project-member] Enqueued Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_members [ 1249.741279] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGHEST for action security_group_members [ 1249.741576] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5147b71-0080-456f-8195-21323de6a67d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.741697] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.741764] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.741953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.742122] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.742221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.742284] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.742428] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.742505] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.742594] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.245135] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.245135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.245135] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.245361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.245361] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.245470] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.245570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.245635] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.248162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.248162] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.248162] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5147b71-0080-456f-8195-21323de6a67d is going to be updated. [ 1250.275143] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.275143] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.275262] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.275955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.275955] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.288470] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5147b71-0080-456f-8195-21323de6a67d in Status: IN_PROGRESS for 2s [ 1251.345812] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1251.346123] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.346319] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.346436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.346625] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.346741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.346810] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.347022] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.347173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.347173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.347289] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.853034] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.853034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.853034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.853259] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.853346] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.853450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.853514] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.853673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.853807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.853865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.854106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.854189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.854250] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.854392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.854532] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.854674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.854674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.855781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.855781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.855781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.855781] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.300212] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5147b71-0080-456f-8195-21323de6a67d in Status: SUCCESS [ 1252.300427] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5147b71-0080-456f-8195-21323de6a67d deletion is rescheduled due to dependency. [ 1252.300742] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.357080] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a25c9a9c-e9a8-445f-ad80-439686ed1021: rpc.has_security_group_logging(os_id): False [ 1252.375053] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.375261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.375261] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.375479] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.375566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.375779] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.375882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.375940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.376116] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.376193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.376396] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.376492] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.376550] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.376710] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.376786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.376987] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.377095] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.377149] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.377287] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.378642] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.378642] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1252.437051] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.437209] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.437279] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.437482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.437620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.451531] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1254.467733] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1254.467733] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.742223] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.742223] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1259.537082] env[65992]: INFO networking_nsxv3.common.synchronization [req-73857f66-b48b-4936-aeaa-59d153f3b1a1 req-7623e814-8f50-4333-92ea-422703c1cf25 tempest-ServerActionsTestOtherB-918399856 tempest-ServerActionsTestOtherB-918399856-project-member] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1259.537082] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1259.537530] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.537530] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.537530] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.537653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.537800] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.537800] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.539291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.539291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.539291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.539291] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.040669] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.040952] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.041084] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.041355] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.041498] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.041802] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.042047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.042160] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.042380] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.042509] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.042716] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1260.078786] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.079033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.079033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.079229] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.079371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.093999] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1262.105953] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1262.106385] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c deletion is rescheduled due to dependency. [ 1262.106385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.253364] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.253665] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.253922] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.254268] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.254493] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.758040] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.260654] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.763403] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1263.763534] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1263.971212] env[65992]: INFO networking_nsxv3.common.synchronization [req-bb8e5cf6-f5d7-415d-b047-bed1c1fe261f req-1085e1a6-1501-436c-922b-c8ebf430b841 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1263.971987] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1263.972448] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.972709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.974812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.974812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.974812] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.974812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.974812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.974812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.974812] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.974812] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.475770] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.528889] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.529078] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.529182] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.529480] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.546769] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1264.547828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.548828] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1264.590096] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.590096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.590096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.590096] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.602021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.602775] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1264.602882] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1264.602985] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1264.740608] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.740608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.740608] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.741406] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.743088] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.743289] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1264.836182] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.836503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.836503] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.836594] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.836930] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.837272] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1264.929568] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.929736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.929736] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.930072] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.930407] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.930745] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1264.930852] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a5147b71-0080-456f-8195-21323de6a67d', '8e720f82-4c36-4848-b271-696bfa23a791', '6743c98c-32bc-40d6-b15c-7a982090892d', '58a9088b-471e-48ab-8bf1-877d11c93872', '01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c', 'b680f30c-1e44-4a84-83f2-ddbc61e8000b', '763682a6-c9f9-4906-bec2-c14372760919', 'e35d0a29-9466-4e93-850f-29921a743936', '724ff346-b8e9-4eb5-b30d-7bfeb697d754', '763a8bb4-e723-4b5a-82e4-e15be73f1f0c', '6866765e-0cdc-4d35-aa21-1b0f99339ef0', '12a7f9db-1203-43be-8fe2-0b76907a767d', '09fa0638-1a13-4fbd-a918-e188dff752a0', 'fa4dd424-5723-4237-8888-a19ff8313111', '28bffb22-a20b-4d92-96ba-3c6eaf3fac7b', '6417014f-241b-4b36-8b7b-aeef9e200013', '0d26e35f-7f74-471f-aa86-2ea84a3690b8', '85011876-1ce8-49d5-9b25-2c9588597a4a', '7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8', 'ac3fb6b8-5af1-492f-992f-9183de28faa7', '8abc7e6f-b99b-4856-9c2c-59b9b0971df3', '308a2531-7733-489b-8a70-8bf49437f735', '246ce419-a7b7-4e23-8bd8-c4c071ac447a', 'dc75e044-2bf1-4d6d-8a88-0619925a4394', 'a25c9a9c-e9a8-445f-ad80-439686ed1021', '9b680e30-6d7d-4efa-b160-f9820a859bcb', '06f48e26-5b6b-4a62-b58e-5e3abec6c0c9', 'ee1e9fbc-60a5-4bb6-b1d4-db4a0173fd23', '7883ea2f-8e33-46ff-9d56-25973809f24b', 'b9ae5db7-375e-4a37-a1a9-1b791ce8df64', 'f8f9dacc-af29-4b40-93c8-17d4f636d125', '52f7d3e0-c7f6-4ac9-a8e2-47a79ec9e5c3', '99ccfab0-6e2c-47ee-96d4-89d24c4d4bc7', 'f7f9886e-09d8-4717-8a0d-1c46fb28d7ff', '436e4ee0-1cae-4512-b766-d84853476f90', '5c719830-8963-41da-a846-e107a5d18360', 'ed0b38e7-705e-40dd-972f-3a9d14a5f23f', '50f8b602-7d1f-4e01-aba4-88750c95b873', '8cfe847e-e52d-4dbf-b3e4-d3dda62d55b6', '92df56c0-4890-4336-9656-3c0ad1e3b068', '4fca3990-1a47-43bc-b0dc-d0194335893d', 'b14e2cad-daae-4705-9dc6-6e9de8cef89f', 'aa8c9176-c0d4-4732-93ba-a80e6182488b', '579076b3-83ee-4ba4-9a58-7938062d1f76', '34a7c14c-af0d-4c42-abda-f1b7e2eebf3c', '4f8fddf5-e496-4959-a3e0-b872a3fbc0e7', '94744e32-5aaa-4c96-a135-74003f101fb3', 'aafaab8c-0f8b-4ded-b666-286994920d39'} {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1264.930962] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1264.952909] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.953098] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.954029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.954029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.954029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.954029] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1264.954029] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1264.954029] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1264.980272] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.031580] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.031796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.031796] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.032019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.033396] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.033724] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1265.033811] env[65992]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65992) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1265.033884] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1265.033944] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1265.034042] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1265.034144] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGH for action security_group_rules [ 1265.034223] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGH for action security_group_rules [ 1265.034290] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGH for action security_group_rules [ 1265.034354] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGH for action security_group_rules [ 1265.034397] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGH for action security_group_rules [ 1265.034461] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGH for action security_group_rules [ 1265.034506] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGH for action security_group_rules [ 1265.034562] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGH for action security_group_rules [ 1265.034628] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGH for action security_group_rules [ 1265.034679] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGH for action security_group_rules [ 1265.034734] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGH for action security_group_rules [ 1265.034787] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGH for action security_group_rules [ 1265.034841] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGH for action security_group_rules [ 1265.034893] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGH for action security_group_rules [ 1265.034955] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGH for action security_group_rules [ 1265.035019] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGH for action security_group_rules [ 1265.035084] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGH for action security_group_rules [ 1265.035286] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGH for action security_group_rules [ 1265.035442] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGH for action security_group_rules [ 1265.035493] env[65992]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGH for action security_group_rules [ 1265.035590] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.482534] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.483108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.483108] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.483255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.483313] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.483439] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c719830-8963-41da-a846-e107a5d18360 is going to be updated. [ 1265.540686] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.540889] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.540989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.541263] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.541447] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.553405] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: IN_PROGRESS for 2s [ 1267.565167] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: SUCCESS [ 1267.565544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.973087] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.973480] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1268.973480] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5147b71-0080-456f-8195-21323de6a67d with Priority: HIGH for action security_group_rules [ 1268.973602] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6743c98c-32bc-40d6-b15c-7a982090892d with Priority: HIGH for action security_group_rules [ 1268.973670] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763682a6-c9f9-4906-bec2-c14372760919 with Priority: HIGH for action security_group_rules [ 1268.974132] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b with Priority: HIGH for action security_group_rules [ 1268.974132] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 with Priority: HIGH for action security_group_rules [ 1268.974132] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 with Priority: HIGH for action security_group_rules [ 1268.974328] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85011876-1ce8-49d5-9b25-2c9588597a4a with Priority: HIGH for action security_group_rules [ 1268.974328] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 with Priority: HIGH for action security_group_rules [ 1268.974436] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4dd424-5723-4237-8888-a19ff8313111 with Priority: HIGH for action security_group_rules [ 1268.974532] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6417014f-241b-4b36-8b7b-aeef9e200013 with Priority: HIGH for action security_group_rules [ 1268.974725] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 with Priority: HIGH for action security_group_rules [ 1268.974725] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a7f9db-1203-43be-8fe2-0b76907a767d with Priority: HIGH for action security_group_rules [ 1268.974820] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 with Priority: HIGH for action security_group_rules [ 1268.974872] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c with Priority: HIGH for action security_group_rules [ 1268.974960] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 with Priority: HIGH for action security_group_rules [ 1268.975060] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b with Priority: HIGH for action security_group_rules [ 1268.975169] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e35d0a29-9466-4e93-850f-29921a743936 with Priority: HIGH for action security_group_rules [ 1268.975284] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGH for action security_group_rules [ 1268.975386] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e720f82-4c36-4848-b271-696bfa23a791 with Priority: HIGH for action security_group_rules [ 1268.975492] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a9088b-471e-48ab-8bf1-877d11c93872 with Priority: HIGH for action security_group_rules [ 1268.975910] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5147b71-0080-456f-8195-21323de6a67d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.976106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.976172] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.976499] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.976499] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5147b71-0080-456f-8195-21323de6a67d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.977515] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6743c98c-32bc-40d6-b15c-7a982090892d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.977619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.977619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.977770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.977844] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6743c98c-32bc-40d6-b15c-7a982090892d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.979044] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763682a6-c9f9-4906-bec2-c14372760919 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.979044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.979044] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.979235] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.979484] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763682a6-c9f9-4906-bec2-c14372760919',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.980116] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.980116] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.980116] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.981029] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.981029] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bffb22-a20b-4d92-96ba-3c6eaf3fac7b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.981029] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3fb6b8-5af1-492f-992f-9183de28faa7 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.981176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.981176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.981294] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.981367] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3fb6b8-5af1-492f-992f-9183de28faa7',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.982078] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.982193] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.982236] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.982398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.982433] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.983437] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85011876-1ce8-49d5-9b25-2c9588597a4a taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.983437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.983673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.983673] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.983673] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85011876-1ce8-49d5-9b25-2c9588597a4a',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.984634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.984634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.984634] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.985175] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.985175] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d26e35f-7f74-471f-aa86-2ea84a3690b8',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.985471] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa4dd424-5723-4237-8888-a19ff8313111 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.985626] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.986378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.986378] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.986378] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa4dd424-5723-4237-8888-a19ff8313111',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.986760] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6417014f-241b-4b36-8b7b-aeef9e200013 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.986846] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.986882] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.987021] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.987114] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6417014f-241b-4b36-8b7b-aeef9e200013',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.987867] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09fa0638-1a13-4fbd-a918-e188dff752a0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.987867] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.988422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.988422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.988422] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09fa0638-1a13-4fbd-a918-e188dff752a0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.988856] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12a7f9db-1203-43be-8fe2-0b76907a767d taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.988856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.988856] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.990038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.990038] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12a7f9db-1203-43be-8fe2-0b76907a767d',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.990038] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.990038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.990038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.990038] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.990442] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6866765e-0cdc-4d35-aa21-1b0f99339ef0',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.991327] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.991327] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.992127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.992127] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.992127] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763a8bb4-e723-4b5a-82e4-e15be73f1f0c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.992267] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.992371] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.992436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.992580] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.992657] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('724ff346-b8e9-4eb5-b30d-7bfeb697d754',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.994049] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.994049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.994049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.994049] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.994049] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b680f30c-1e44-4a84-83f2-ddbc61e8000b',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.994696] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e35d0a29-9466-4e93-850f-29921a743936 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.994786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.994786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.994907] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.994992] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e35d0a29-9466-4e93-850f-29921a743936',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.995634] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.995768] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.995830] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.995918] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.995987] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.996695] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e720f82-4c36-4848-b271-696bfa23a791 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.996819] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.996874] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.997019] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.997108] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e720f82-4c36-4848-b271-696bfa23a791',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.999648] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58a9088b-471e-48ab-8bf1-877d11c93872 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.999753] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.999836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.999965] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.000064] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58a9088b-471e-48ab-8bf1-877d11c93872',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.031283] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.031283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.031283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.031283] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.035952] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.036148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.037518] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.037622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.038400] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.038512] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.053221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.053292] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3fb6b8-5af1-492f-992f-9183de28faa7 is going to be deleted. [ 1269.054191] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.055014] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.079032] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.079032] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5147b71-0080-456f-8195-21323de6a67d is going to be deleted. [ 1269.079613] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.079865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.114836] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.115045] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8 is going to be deleted. [ 1269.116392] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.116619] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.178940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.179244] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763682a6-c9f9-4906-bec2-c14372760919 is going to be deleted. [ 1269.185551] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.185801] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.185865] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.186136] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.186280] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.186411] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3fb6b8-5af1-492f-992f-9183de28faa7" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.187306] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.187446] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.187536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.187783] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.187906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.188335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5147b71-0080-456f-8195-21323de6a67d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.206253] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.206450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.206519] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.206847] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.206978] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.207109] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a54b8d1-ffd9-48c8-9f2c-1bb8df149ac8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.237127] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.237337] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.237385] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.237584] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.237680] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.237829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763682a6-c9f9-4906-bec2-c14372760919" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.566278] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.566278] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.566607] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.566651] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.568336] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.568507] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.569599] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.569709] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.570429] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.570521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.571162] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.571255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.571939] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.572042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.572732] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.572821] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.573541] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.573633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.574347] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.574441] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.575131] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.575226] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.575978] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.576070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.576715] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.577155] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.577245] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.578197] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.578604] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.578738] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.579302] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.579688] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.579770] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.580305] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.580689] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.580787] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.581460] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.581840] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.581946] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.597360] env[65992]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1269.597843] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.597970] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12a7f9db-1203-43be-8fe2-0b76907a767d is going to be deleted. [ 1269.598884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.599128] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.621362] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.621523] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6417014f-241b-4b36-8b7b-aeef9e200013 is going to be deleted. [ 1269.622653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.623177] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.645791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.645933] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58a9088b-471e-48ab-8bf1-877d11c93872 is going to be deleted. [ 1269.646898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.647133] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.673931] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.674200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.688494] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.688673] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b680f30c-1e44-4a84-83f2-ddbc61e8000b is going to be deleted. [ 1269.689898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.690163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.700757] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.700941] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.720847] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.721082] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.743094] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.743280] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bffb22-a20b-4d92-96ba-3c6eaf3fac7b is going to be deleted. [ 1269.744237] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.744471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.795282] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.795488] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 724ff346-b8e9-4eb5-b30d-7bfeb697d754 is going to be deleted. [ 1269.796334] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.796549] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.828989] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.829201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.838948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.839095] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6743c98c-32bc-40d6-b15c-7a982090892d is going to be deleted. [ 1269.840073] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.840298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.900221] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.900398] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e720f82-4c36-4848-b271-696bfa23a791 is going to be deleted. [ 1269.901421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.901639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.903132] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.903239] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.946575] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.946791] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.949679] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.949854] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6866765e-0cdc-4d35-aa21-1b0f99339ef0 is going to be deleted. [ 1269.950876] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.951176] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.031785] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.032163] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.037542] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.037677] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d26e35f-7f74-471f-aa86-2ea84a3690b8 is going to be deleted. [ 1270.038656] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.038886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.040326] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.040432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.097741] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.097950] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85011876-1ce8-49d5-9b25-2c9588597a4a is going to be deleted. [ 1270.099034] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.099310] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.115902] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.116115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.200290] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.200469] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be deleted. [ 1270.201786] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.202100] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.236067] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.236285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.280829] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.280988] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e35d0a29-9466-4e93-850f-29921a743936 is going to be deleted. [ 1270.281973] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.282208] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.312264] env[65992]: INFO networking_nsxv3.common.synchronization [req-ecf6406a-a713-4aa8-a8fe-2eb73c625939 req-828e3f50-7e84-4f22-a305-f39f268844e3 tempest-ServerActionsTestOtherB-918399856 tempest-ServerActionsTestOtherB-918399856-project-member] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1270.313754] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1270.313997] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.314445] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.314521] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.318065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.318065] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.318065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.318065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.318065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.318065] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.318065] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.329980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.329980] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09fa0638-1a13-4fbd-a918-e188dff752a0 is going to be deleted. [ 1270.333375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.333375] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.334869] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.335033] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.392023] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.392242] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.396782] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.396953] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.424391] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.424603] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.430840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.430840] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763a8bb4-e723-4b5a-82e4-e15be73f1f0c is going to be deleted. [ 1270.430840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.430840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.457446] env[65992]: INFO networking_nsxv3.common.synchronization [req-f190bebf-5ec0-4630-9f26-3fabe4afd875 req-6fc9a2eb-f14d-4cab-816d-3b4b54f53ce8 tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1270.458109] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c719830-8963-41da-a846-e107a5d18360 with Priority: HIGHEST for action security_group_members [ 1270.458321] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c719830-8963-41da-a846-e107a5d18360 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.458459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.458523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.458744] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.458903] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.458997] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.459291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.459523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.459664] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.459807] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c719830-8963-41da-a846-e107a5d18360',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.484475] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.484628] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa4dd424-5723-4237-8888-a19ff8313111 is going to be deleted. [ 1270.486071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.486315] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.486405] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.486527] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12a7f9db-1203-43be-8fe2-0b76907a767d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.489167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.489167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.489167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.489167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6417014f-241b-4b36-8b7b-aeef9e200013" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.489167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.489167] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.489421] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.489525] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58a9088b-471e-48ab-8bf1-877d11c93872" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.489824] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.490070] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.490295] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.490523] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b680f30c-1e44-4a84-83f2-ddbc61e8000b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.490740] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.490982] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.491151] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.491450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bffb22-a20b-4d92-96ba-3c6eaf3fac7b" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.491864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.491864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.491864] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.492042] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-724ff346-b8e9-4eb5-b30d-7bfeb697d754" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.492566] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.492776] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.492988] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.493206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6743c98c-32bc-40d6-b15c-7a982090892d" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.493394] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.493641] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.493817] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.494141] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e720f82-4c36-4848-b271-696bfa23a791" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.494335] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.494622] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.494721] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.494940] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6866765e-0cdc-4d35-aa21-1b0f99339ef0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.495640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.495884] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.496085] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.496286] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d26e35f-7f74-471f-aa86-2ea84a3690b8" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.496909] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.497171] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.497350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.497596] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85011876-1ce8-49d5-9b25-2c9588597a4a" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.498281] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.498536] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.498839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.498839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.499461] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.499692] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.499898] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.500379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e35d0a29-9466-4e93-850f-29921a743936" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.500379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.500620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.500620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.500822] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09fa0638-1a13-4fbd-a918-e188dff752a0" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.580502] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.580712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.580712] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.580962] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.581069] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.581192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763a8bb4-e723-4b5a-82e4-e15be73f1f0c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.603382] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.603576] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.603624] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.603929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.604075] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.604255] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa4dd424-5723-4237-8888-a19ff8313111" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.732978] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.733248] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.733373] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.733639] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.733912] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.734108] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.734234] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.734454] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.734591] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.734797] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.734906] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.735023] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.735143] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.735254] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.735354] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.735482] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.760903] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.761137] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1270.761268] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.761442] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.761760] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-2377172e-1af3-4d62-a0fb-03f5418b6ddf taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.761937] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.762066] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.762477] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.762671] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2377172e-1af3-4d62-a0fb-03f5418b6ddf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.818324] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.818541] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.818592] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.818789] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.818886] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.819101] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.819203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.819265] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.819418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.819493] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.819579] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be deleted. [ 1270.849719] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.849963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.849963] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.850201] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.850292] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.850414] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.962738] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.963102] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.963220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.963516] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.990948] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.991380] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.991585] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.991683] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.991980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.992522] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.992522] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c719830-8963-41da-a846-e107a5d18360 is going to be updated. [ 1271.038189] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.038189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.038189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.038189] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.039577] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.051727] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: IN_PROGRESS for 2s [ 1271.265556] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.265849] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.266028] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.266431] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.266614] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.266803] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Segment Port 2377172e-1af3-4d62-a0fb-03f5418b6ddf not found, creating... [ 1271.267168] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.267355] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.267553] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.267861] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.268090] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.268411] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.268607] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.268744] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.269016] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.269224] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.269394] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 2377172e-1af3-4d62-a0fb-03f5418b6ddf is going to be created. [ 1271.299315] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.299584] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.299780] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.300231] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.300631] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.300990] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.989225] env[65992]: INFO networking_nsxv3.common.synchronization [req-ecf6406a-a713-4aa8-a8fe-2eb73c625939 req-99f6447b-7517-4324-9ea3-6dd071a8b914 service nova] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 1271.989380] env[65992]: INFO networking_nsxv3.common.synchronization [req-ecf6406a-a713-4aa8-a8fe-2eb73c625939 req-99f6447b-7517-4324-9ea3-6dd071a8b914 service nova] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1271.989805] env[65992]: INFO networking_nsxv3.common.synchronization [req-ecf6406a-a713-4aa8-a8fe-2eb73c625939 req-99f6447b-7517-4324-9ea3-6dd071a8b914 service nova] Enqueued Resource ID: 2377172e-1af3-4d62-a0fb-03f5418b6ddf with Priority: HIGHEST for action port [ 1271.989805] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 1271.989990] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1271.989990] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2377172e-1af3-4d62-a0fb-03f5418b6ddf with Priority: HIGHEST for action port [ 1271.990503] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.990726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.990828] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.991106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.991227] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.992120] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.992272] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.992364] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.992568] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.992742] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.992872] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.992989] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.993181] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.993296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.993405] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.994929] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2377172e-1af3-4d62-a0fb-03f5418b6ddf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.994929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.994929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.994929] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.994929] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2377172e-1af3-4d62-a0fb-03f5418b6ddf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.496348] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.497511] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.497726] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.497813] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2377172e-1af3-4d62-a0fb-03f5418b6ddf with status ACTIVE [ 1272.497981] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.498106] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.498194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.498391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.498636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.498636] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.498769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.498804] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.498958] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.499045] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.499255] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.499386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.499386] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.499558] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.499633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.499696] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2377172e-1af3-4d62-a0fb-03f5418b6ddf is going to be updated. [ 1272.524046] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.524257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.524299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.524640] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.524807] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.524980] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.001681] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.061836] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c719830-8963-41da-a846-e107a5d18360 in Status: SUCCESS [ 1273.063269] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c719830-8963-41da-a846-e107a5d18360 deletion is rescheduled due to dependency. [ 1273.063269] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c719830-8963-41da-a846-e107a5d18360" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.504491] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.504491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.504491] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.504945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.504945] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.504945] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be created. [ 1273.531692] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.531905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.531905] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.532129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.532289] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.542945] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: UNINITIALIZED for 2s [ 1274.974357] env[65992]: INFO networking_nsxv3.common.synchronization [None req-e366ff30-d964-4b7c-b71b-dabdb05bfddc tempest-AttachInterfacesTestJSON-685939138 tempest-AttachInterfacesTestJSON-685939138-project-member] Enqueued Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1274.975189] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 with Priority: HIGHEST for action security_group_members [ 1274.975330] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25c9a9c-e9a8-445f-ad80-439686ed1021 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.975422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.975422] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.975816] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.975896] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.976047] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.976089] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.977637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.977637] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.977637] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25c9a9c-e9a8-445f-ad80-439686ed1021',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.479202] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.479391] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.479433] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.479668] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.500418] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.500687] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.500806] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.500920] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.501115] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.501200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.501283] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 is going to be updated. [ 1275.529271] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.529271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.529271] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.529508] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.529639] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.540430] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: IN_PROGRESS for 2s [ 1275.551350] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1275.551586] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.551767] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.552011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.552204] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.552324] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.552389] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.552544] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.552620] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.552704] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.552792] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.054806] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.557273] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c: rpc.has_security_group_logging(os_id): False [ 1276.576457] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.576457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.576457] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.576703] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.576805] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.577191] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.577296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.577296] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.578110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.578110] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.578110] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be created. [ 1276.646291] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.646291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.646291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.646291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.646291] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.659445] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1277.550206] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 in Status: SUCCESS [ 1277.550206] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25c9a9c-e9a8-445f-ad80-439686ed1021 deletion is rescheduled due to dependency. [ 1277.550206] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25c9a9c-e9a8-445f-ad80-439686ed1021" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.672369] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1278.672802] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.976424] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.976424] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1281.725117] env[65992]: INFO networking_nsxv3.common.synchronization [req-040de2c4-f6ed-48dd-89ff-80e7cef38216 req-e138f542-1e1b-44da-b0dd-a2f3046dfc58 tempest-ServerActionsTestJSON-2117927839 tempest-ServerActionsTestJSON-2117927839-project-member] Enqueued Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1281.725117] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 with Priority: HIGHEST for action security_group_members [ 1281.725398] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-92df56c0-4890-4336-9656-3c0ad1e3b068 taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.725398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.725486] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.725657] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.725812] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.725910] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.725971] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.726129] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.726214] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.726321] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92df56c0-4890-4336-9656-3c0ad1e3b068',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.229101] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.229349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.229349] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.229543] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.252185] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.252440] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.252567] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.252633] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.252827] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.252903] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.253050] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 is going to be updated. [ 1282.294059] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.294332] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.294416] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.294653] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.294799] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.318944] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: IN_PROGRESS for 2s [ 1284.330562] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 in Status: SUCCESS [ 1284.330951] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92df56c0-4890-4336-9656-3c0ad1e3b068 deletion is rescheduled due to dependency. [ 1284.330951] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92df56c0-4890-4336-9656-3c0ad1e3b068" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.726015] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.726378] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1291.726977] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.727513] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.728063] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.728063] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1301.729258] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.729675] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1306.730672] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.731090] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1311.732786] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1311.732786] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1316.733966] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1316.734392] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1321.735098] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.735098] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1326.735914] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1326.736468] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1331.737149] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.737545] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1336.738415] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.738415] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.739015] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.739406] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.643774] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.643982] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.644115] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.644442] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.644725] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.644879] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.645018] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.645424] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.645581] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.645906] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1342.646061] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] NeedRegenerationException {{(pid=65992) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1342.646199] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] no value, waiting for create lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1342.646312] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] value creation lock acquired {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1342.646449] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] No value present for key: 'zone-id' {{(pid=65992) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1342.646582] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Calling creation function for not-yet-present value {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.646747] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.684743] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.684918] env[65992]: DEBUG dogpile.cache.region [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65992) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1342.685042] env[65992]: DEBUG dogpile.lock [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Released creation lock {{(pid=65992) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.685216] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "network-378" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.685521] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock port-2377172e-1af3-4d62-a0fb-03f5418b6ddf taken with stack trace [, , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.685694] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.685814] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.686127] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.686268] env[65992]: DEBUG networking_nsxv3.api.rpc [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2377172e-1af3-4d62-a0fb-03f5418b6ddf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.189433] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.189877] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.189928] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.190292] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.190463] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.190788] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.190981] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.191187] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.191450] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.191617] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.191937] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.192130] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.192274] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.192510] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.192686] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.192838] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Resource: SegmentPort with ID: 2377172e-1af3-4d62-a0fb-03f5418b6ddf is going to be updated. [ 1343.216177] env[65992]: DEBUG networking_nsxv3.common.locking [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.216397] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.216513] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.216795] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.216988] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.217222] env[65992]: DEBUG oslo_concurrency.lockutils [None req-d7ea66c0-ed87-4ff5-970d-98a517a1913e None None] Releasing lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.879766] env[65992]: INFO networking_nsxv3.common.synchronization [req-9ba3e620-1522-448e-9be2-cfedf896cc9a req-1338c19e-a2c8-4c54-a981-3a1af4ce6ce3 service nova] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 1343.879766] env[65992]: INFO networking_nsxv3.common.synchronization [req-9ba3e620-1522-448e-9be2-cfedf896cc9a req-1338c19e-a2c8-4c54-a981-3a1af4ce6ce3 service nova] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1343.879766] env[65992]: INFO networking_nsxv3.common.synchronization [req-9ba3e620-1522-448e-9be2-cfedf896cc9a req-1338c19e-a2c8-4c54-a981-3a1af4ce6ce3 service nova] Enqueued Resource ID: 2377172e-1af3-4d62-a0fb-03f5418b6ddf with Priority: HIGHEST for action port [ 1343.879996] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_rules [ 1343.880121] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1343.880233] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2377172e-1af3-4d62-a0fb-03f5418b6ddf with Priority: HIGHEST for action port [ 1343.880475] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.880589] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.880645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.881055] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.881055] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.881753] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.882241] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.882312] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.882564] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.883419] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.883534] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.883600] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.883943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.883943] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.884081] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.884814] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock port-2377172e-1af3-4d62-a0fb-03f5418b6ddf taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.884928] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.884992] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.885154] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.885232] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2377172e-1af3-4d62-a0fb-03f5418b6ddf',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.387034] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.387437] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.387437] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.388254] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2377172e-1af3-4d62-a0fb-03f5418b6ddf with status ACTIVE [ 1344.388454] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.388570] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.388636] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.388839] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.388924] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.389108] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.389203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.389257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.389409] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.389482] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.389662] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.389760] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.389831] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.390011] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.390192] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.390192] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2377172e-1af3-4d62-a0fb-03f5418b6ddf is going to be updated. [ 1344.411086] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.411299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.411299] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.411436] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.411645] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.411769] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2377172e-1af3-4d62-a0fb-03f5418b6ddf" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.892658] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.395392] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.395798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.395798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.395798] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.395911] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.395955] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1345.437138] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.437350] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.437432] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.437711] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.437906] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.448946] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1347.461465] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1347.461879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.461879] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.462173] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.462477] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.462674] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.462781] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.463064] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.463220] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.463379] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.463543] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.966942] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.469252] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c: rpc.has_security_group_logging(os_id): False [ 1348.490329] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.490565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.490565] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.490750] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.490838] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.491106] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.491194] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.491257] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.491398] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.491471] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.491597] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1348.563470] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.563777] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.563883] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.564203] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.564450] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.579659] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1348.881391] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.881564] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1350.601066] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1350.601459] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.882766] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.883308] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.883645] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.884138] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.952298] env[65992]: INFO networking_nsxv3.common.synchronization [req-8c4a8da5-5e5d-4f7d-bb5d-3b233464745d req-36d5c729-7326-4eff-9130-1a9709338cf8 tempest-ServerActionsTestOtherB-918399856 tempest-ServerActionsTestOtherB-918399856-project-member] Enqueued Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1359.952298] env[65992]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c with Priority: HIGHEST for action security_group_members [ 1359.952298] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c taken with stack trace [, , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.952298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.952298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.952298] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.952298] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.952840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.952840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.952840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.952840] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.952840] env[65992]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c',) {} {{(pid=65992) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.455220] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.455410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.455410] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.455618] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.455707] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.455898] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.455995] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.456071] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.456213] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.456285] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.456371] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c is going to be updated. [ 1360.487927] env[65992]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65992) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.488148] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.488200] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.488401] env[65992]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.488569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.498294] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: IN_PROGRESS for 2s [ 1362.509193] env[65992]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c in Status: SUCCESS [ 1362.509569] env[65992]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c deletion is rescheduled due to dependency. [ 1362.509569] env[65992]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01d0dd1c-807a-4a8e-beeb-f4a0902d3f1c" {{(pid=65992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.953026] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.953459] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.953935] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.954320] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.955594] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.955594] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.956315] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.956315] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.957959] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.958522] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.959040] env[65992]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.959040] env[65992]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0